-- Logs begin at Wed 2022-05-04 18:05:58 UTC, end at Wed 2022-05-04 19:24:47 UTC. -- May 04 18:51:36.856947 dv-cinder-830901-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 18:51:36.864253 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 18:51:36 2022] *** May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: nodename: dv-cinder-830901-3-iscsi May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: machine: x86_64 May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: clock source: unix May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: pcre jit disabled May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: detected number of CPU cores: 4 May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: current working directory: / May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: detected binary path: /usr/bin/uwsgi-core May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: your processes number limit is 47680 May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: your memory page size is 4096 bytes May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: detected max file descriptor number: 2048 May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: lock engine: pthread robust mutexes May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: thunder lock: enabled May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 18:51:36.868549 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 18:51:36.913159 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: Python main interpreter initialized at 0x561e55b829c0 May 04 18:51:36.913159 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: python threads support enabled May 04 18:51:36.913159 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: your server socket listen backlog is limited to 100 connections May 04 18:51:36.913159 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: your mercy for graceful operations on workers is 90 seconds May 04 18:51:36.913558 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: mapped 403077 bytes (393 KB) for 2 cores May 04 18:51:36.913629 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: *** Operational MODE: preforking *** May 04 18:51:36.913867 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: *** uWSGI is running in multiple interpreter mode *** May 04 18:51:36.913867 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: spawned uWSGI master process (pid: 79869) May 04 18:51:36.914083 dv-cinder-830901-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 18:51:36.917362 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: spawned uWSGI worker 1 (pid: 79880, cores: 1) May 04 18:51:36.917362 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: spawned uWSGI worker 2 (pid: 79881, cores: 1) May 04 18:51:36.917362 dv-cinder-830901-3-iscsi devstack@keystone.service[79869]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 18:51:42.628440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:51:42.628440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: from cryptography.utils import int_from_bytes May 04 18:51:42.629233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:51:42.629233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: from cryptography.utils import int_from_bytes May 04 18:51:42.629338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:51:42.629338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: from cryptography.utils import int_from_bytes May 04 18:51:42.629338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:51:42.629338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: from cryptography.utils import int_from_bytes May 04 18:51:42.678613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 18:51:42.678770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 18:51:42.678844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 18:51:42.678919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 18:51:42.678985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] command line args: [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 18:51:42.679209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] command line args: [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 18:51:42.679296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 18:51:42.679356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 18:51:42.679412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ================================================================================ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 18:51:42.679559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ================================================================================ {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 18:51:42.679646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] admin_token = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.679802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] admin_token = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.679888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config_dir = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] config_dir = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config_source = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] config_source = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] debug = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] debug = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.680959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.682929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] list_limit = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] log_config_append = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_config_append = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] log_dir = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] log_file = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.683943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_dir = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.684937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.685439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.686129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.686304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.686542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.686710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.686946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.687120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.687120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.687505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.687505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] publish_errors = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.687927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.688098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.688294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] publish_errors = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.688529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.688697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.688890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.689085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.689313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.689518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.689806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.690014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.690240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] standard_threads = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.690746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.690947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.691138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] standard_threads = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.691315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.691457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.691588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.691773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.691920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] use_journal = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.692052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.692181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] use_json = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.692309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_journal = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.692470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] use_stderr = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.692618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_json = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.692758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] use_syslog = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.693001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_stderr = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.693140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.693303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_syslog = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.693440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.693612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:51:42.693792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.693957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.694092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.694228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.694358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.694492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.694634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.694765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.694893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.695021 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.695166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.695302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.695513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.695646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.695781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.695911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.696039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.696173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.696312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.696934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.697067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.697195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.697323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.697450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.697674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.697806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.697954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.698142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.698307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.698442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.698580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.698718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.698850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.698980 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.699107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.699242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.699385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.699532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.699663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.699792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.699919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.700965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.701095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.701235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.701447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.701660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.701801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.701942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.702079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.702209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.702343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.702473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.702675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.702813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.702944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.703079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.703208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.703348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.703489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.703620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.703749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.703882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.704932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.705072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.705212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.705352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.705522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.705660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.705789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.705929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.706061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.706189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.706316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.706450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.706580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.706720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.706850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.708039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.708249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.708448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.708645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.708879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.709050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.709247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.709441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.709751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.709921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.710155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.710325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.710585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.710792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.711007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.711178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.711413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.711582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.711777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.712005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.712811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.713007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.713249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.713419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.713623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.713785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.713950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.714125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.714272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.714415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.714583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.714723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.714863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.715000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.715140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.715319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.715476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.715610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.715740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.715870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.716971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.717102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.717236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.717367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.717548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.717687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.717828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.717972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.718102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.718231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.718361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.718490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.718629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.718760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.718890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.719019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.719183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.719347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.719558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.719693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.719834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.719971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.720102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.720230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.720371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.720502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.720631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.720760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.720895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.721025 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.721166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.721297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.721427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.721579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.721731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.721864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.722937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.723080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.723212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.723341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.723470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.723609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.723739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.723881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.724938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.725910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] auth.external = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.external = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.726942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.727243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.727377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] auth.password = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.727507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.727638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] auth.token = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.727767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.password = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.727897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.token = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.728977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.729110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.729241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.729371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.729536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.729686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.729821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] credential.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.729952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.730082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.730222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.730354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.730498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.730632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.730762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.730904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.731976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.732115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.732247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.732378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.732507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.732637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.732782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.732922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.733055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.733185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.733316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.733506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.733650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.733795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.733928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.734059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.734189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.734321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.734488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.734646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.734779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.734909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.735039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.735169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.735308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.735524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.735659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.735792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.736026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.736194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.736330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.736507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.736646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.736790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.736922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.737053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.737183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.737328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.737480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.737619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.737760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.737893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.738024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.738162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.738295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.738427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.738570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.738701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.738900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.739980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.740111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.740241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.740371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.740525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.740659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.740790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.740920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.741050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.741181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.741322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.741501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.741642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.741773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.741904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.742043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.742185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.742335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.742467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.742689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.742858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.743066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.743242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.743379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.743510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.743639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.743770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.743900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.744977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.745107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.745236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.745372 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.745595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.745777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.745915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.746991 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.747120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.747249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.747388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.747519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.747649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.747779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.747909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.748048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.748198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.748332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.748462 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.748592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.748739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.748943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.749121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.749257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.749388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.749538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.749672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.749802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.749945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.750079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.750221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.750352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.750482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.750612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.750750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.750882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.751988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.752120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.752250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.752389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.752521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.752651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.752781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.752910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.753049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.753183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.753313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.753443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.753625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.753757 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.753917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.754092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.754237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.754375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.754511 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.754648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.754793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.754931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.755068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.755205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.755349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.755490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.755636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.755786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.755931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.756069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.756205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.756343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.756489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.756627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.756763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.756900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.757036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.757172 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.757317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.757457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.757621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.757769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.757906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.758043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.758191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.758336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.758475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.758618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.758756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.759373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.759525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.759664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.759807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.759946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.760082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.760229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.760375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.760521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.760660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.760796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.760932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.761068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.761212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.761387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.761584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.761724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.761860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.761997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.762188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.762340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.762478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.762615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.762751 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.762894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.763108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.763249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.763385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.763521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.763658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.763794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.763939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.764078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.764227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.764365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.764501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.764637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.764782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.764927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.765065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.765202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.765345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.765538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.765719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.765864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.766000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] role.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.766137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.766289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] role.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.766426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.766575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.766751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.766895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.767032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.767168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.767306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.767451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.767590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.767726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.767864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.768999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.769138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.769275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.769411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.769595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.769735 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.769885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.770025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.770211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.770355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.770746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.770746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.771977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.772114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.772263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.772402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.772539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.772687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.772827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.772963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.773101 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.773239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.773376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.773545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.773691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.773829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.773965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.774114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.774258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.774404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.775129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.775331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.775484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.775624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.775847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.776994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.777131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.777267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.777405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.777669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.777812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.777956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.778097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.778241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.778381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.778527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.778666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.778813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.778952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.779089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.779227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.779372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.779512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.779650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.779787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.779924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.780936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.connection = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.781961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.782987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.783954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.784026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.784098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.784169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.784250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.784326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 18:51:42.784400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.784400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:51:42.784400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 18:51:42.795074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.795435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.795781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.797216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.797455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.797721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.804925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.806499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.833494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.833831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.834634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.834866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.886951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.887214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.938205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.938576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.938932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:42.939167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.005132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.005358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.005605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.005718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.005832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.006048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.006178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.006263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.006563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.006877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.007191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.007502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.030710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.030918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.031054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.031140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.031349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.031524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.031607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.031768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.031981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.032064 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.032356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.032667 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.032976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.033297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.043436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.043850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.058696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.059054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.059377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.059696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.060011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.060332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.060639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.060722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.060924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.061146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.061363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.061610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.061825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.062036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:51:43.079065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.079400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:51:43.079719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.079929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.080014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:51:43.080256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.080339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:51:43.080452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:51:43.080714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.080849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.080968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.081220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.081352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.081491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.081802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.082145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.092484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.092757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.093022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.093296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.093566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.093933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.094290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.094661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.108357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.108585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.108673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.108673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.108673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.108673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.108673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.108981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.109056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.109818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.110041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.110413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.110780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.111142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.135591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.137251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.137492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.138834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.140529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.140918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.142712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.142989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.143265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.146874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.147260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.147650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.150814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.151092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.155215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.155598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.155679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.155942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.156219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.156498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.156765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.157030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.157572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.160984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.161370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.161772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.162147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.162518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.162886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.163254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.163616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.176154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.176426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.181426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.184049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.184387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.185245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.185623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.189050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.190723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.192776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.193125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.194503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.198788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.198994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.199356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.199704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.200049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.200390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.200730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.202752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.206518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.206870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.207210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.207621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.207876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.208212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.220184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.220633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.220966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.221295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.227344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.227818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.228140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.228461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.229550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.231305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.231645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.234783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.235135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.235498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.235980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.236193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.236869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.238660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.238992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.242187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.242540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.242894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.243760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.244095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.251046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.251429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.251779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.252124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.252472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.252818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.253170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.258243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.258605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.259511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.259847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.260186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.260526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.260888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.272844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.276325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.279518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.279845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.281557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.283068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.283335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.283683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.284048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.286661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.288302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.290002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.290378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.290731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.291961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.293671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.296959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.297317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.297693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.298044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.298530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.300184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.303489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.303835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.304180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.304510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.308244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.308608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.308963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.314422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.314781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.315140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.317216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.317588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.317933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.318287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.318622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.318955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.319292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.319631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.319973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.320315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.320659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.320983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.321312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.322323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.324651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:51:43.324987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.325321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.325684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.326013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.326349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.326679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.327051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.327379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.327711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.328044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.328361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.328680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.329010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:51:43.364715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561e55b829c0 pid: 79881 (default app) May 04 18:51:43.367515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561e55b829c0 pid: 79880 (default app) May 04 18:51:43.368852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee619a61-8a32-443b-a2fe-716bb63f2926 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:43.369145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee619a61-8a32-443b-a2fe-716bb63f2926 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:43.369424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee619a61-8a32-443b-a2fe-716bb63f2926 None None] PATH_INFO: `/v3` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:43.375794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Wed May 4 18:51:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:51:51.387148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2ef1c-0338-4b7e-9e74-d60c9f01296d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:51.387708 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2ef1c-0338-4b7e-9e74-d60c9f01296d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:51.387810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2ef1c-0338-4b7e-9e74-d60c9f01296d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:51.392706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:51:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:51.398492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:51.398945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:51.399109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:51.431365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG oslo_db.sqlalchemy.engines [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:51:51.616562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG passlib.handlers.bcrypt [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79881) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 18:51:51.616977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG passlib.handlers.bcrypt [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79881) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 18:51:51.673029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:51.674590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:51.798580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:51:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 18:51:51.980593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2ef1c-0338-4b7e-9e74-d60c9f01296d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:52.013987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG oslo_db.sqlalchemy.engines [None req-45f2ef1c-0338-4b7e-9e74-d60c9f01296d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:51:52.138824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2ef1c-0338-4b7e-9e74-d60c9f01296d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:52.142957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67d9f3-dec5-4623-9bbc-144f2eb7e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:52.143596 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67d9f3-dec5-4623-9bbc-144f2eb7e605 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:52.143872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67d9f3-dec5-4623-9bbc-144f2eb7e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:52.144140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67d9f3-dec5-4623-9bbc-144f2eb7e605 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:52.152706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67d9f3-dec5-4623-9bbc-144f2eb7e605 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:52.203146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf67d9f3-dec5-4623-9bbc-144f2eb7e605 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 18:51:52.203480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67d9f3-dec5-4623-9bbc-144f2eb7e605 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:52.213351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Wed May 4 18:51:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 18:51:52.218968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:52.233732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9393-b4be-4e6a-996a-0db1a95f92d5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:52.238156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e38f5-5a4a-4c4b-8590-001d3a50db5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:52.239344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e38f5-5a4a-4c4b-8590-001d3a50db5b admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:52.239698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e38f5-5a4a-4c4b-8590-001d3a50db5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:52.240061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e38f5-5a4a-4c4b-8590-001d3a50db5b admin admin] PATH_INFO: `/v3/projects/75aca24ee457414ebddf524e98cb22af` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:52.241678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e38f5-5a4a-4c4b-8590-001d3a50db5b admin admin] RBAC: Authorizing `identity:get_project(project_id=75aca24ee457414ebddf524e98cb22af)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:52.291677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f6e38f5-5a4a-4c4b-8590-001d3a50db5b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 18:51:52.292012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e38f5-5a4a-4c4b-8590-001d3a50db5b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:52.296522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Wed May 4 18:51:52 2022] GET /identity/v3/projects/75aca24ee457414ebddf524e98cb22af => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:51:54.547645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572ea2-3190-4d2b-8916-5b003459894c None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:54.548190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572ea2-3190-4d2b-8916-5b003459894c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:54.548190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572ea2-3190-4d2b-8916-5b003459894c None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:54.552293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:51:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:54.558067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea15fc-67d5-4780-920e-e60b268a12e2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:54.558440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea15fc-67d5-4780-920e-e60b268a12e2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:54.558620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea15fc-67d5-4780-920e-e60b268a12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:54.578909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b6ea15fc-67d5-4780-920e-e60b268a12e2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:54.580399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b6ea15fc-67d5-4780-920e-e60b268a12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:54.588109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:51:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 18:51:54.609786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572ea2-3190-4d2b-8916-5b003459894c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:54.621985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572ea2-3190-4d2b-8916-5b003459894c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:54.626158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1331-30a5-4482-8da3-3a93a9bd8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:54.626776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1331-30a5-4482-8da3-3a93a9bd8ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:54.627054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1331-30a5-4482-8da3-3a93a9bd8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:54.627326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1331-30a5-4482-8da3-3a93a9bd8ddf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:54.635430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1331-30a5-4482-8da3-3a93a9bd8ddf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:54.637194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1331-30a5-4482-8da3-3a93a9bd8ddf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:54.645920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Wed May 4 18:51:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:51:54.651100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea15fc-67d5-4780-920e-e60b268a12e2 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:54.659632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea15fc-67d5-4780-920e-e60b268a12e2 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:54.663914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adf63c-b153-4a3a-8dfe-c3775bc170bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:54.665279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adf63c-b153-4a3a-8dfe-c3775bc170bc admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:54.665588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adf63c-b153-4a3a-8dfe-c3775bc170bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:54.665861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adf63c-b153-4a3a-8dfe-c3775bc170bc admin admin] PATH_INFO: `/v3/users/5b85f3c3beaa4b878ef617b7b044b497` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:54.667228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adf63c-b153-4a3a-8dfe-c3775bc170bc admin admin] RBAC: Authorizing `identity:get_user(user_id=5b85f3c3beaa4b878ef617b7b044b497)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:54.669018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adf63c-b153-4a3a-8dfe-c3775bc170bc admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:54.670596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Wed May 4 18:51:54 2022] GET /identity/v3/users/5b85f3c3beaa4b878ef617b7b044b497 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:51:56.955414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bc428-7446-4c94-a3e2-56da9f0abd07 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:56.955966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bc428-7446-4c94-a3e2-56da9f0abd07 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:56.955966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bc428-7446-4c94-a3e2-56da9f0abd07 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:56.957305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:56.963311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be7fb-d2f3-4e79-973e-e4e238c7bf0a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:56.963738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be7fb-d2f3-4e79-973e-e4e238c7bf0a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:56.963871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be7fb-d2f3-4e79-973e-e4e238c7bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:56.999497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722321d-4dbc-4cba-8f44-aad61e775b0b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:56.999783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722321d-4dbc-4cba-8f44-aad61e775b0b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.000059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722321d-4dbc-4cba-8f44-aad61e775b0b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.001438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:51:57.007063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.007345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.007618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.049789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG passlib.handlers.bcrypt [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79880) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 18:51:57.050212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG passlib.handlers.bcrypt [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79880) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 18:51:57.092339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-fb5be7fb-d2f3-4e79-973e-e4e238c7bf0a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:57.093572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-fb5be7fb-d2f3-4e79-973e-e4e238c7bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:57.098122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:57.099673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:57.169801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:51:57.192148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be7fb-d2f3-4e79-973e-e4e238c7bf0a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.195563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:51:57.218598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.285940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be7fb-d2f3-4e79-973e-e4e238c7bf0a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.311726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12a3b-c897-426d-aebe-04a9436f5247 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.317225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.318033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.318323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.318588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.329649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:51:57.340622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:51:57.341633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:51:57.342626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 7/14] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:51:57.344109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.345005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.345292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.345610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.347578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.410176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:57.411705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:57.441190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6cad-007d-45e7-aa37-5a21b1bc0eac None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.473371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.474000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.474283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.474558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.475305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:51:57.475613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:57.476995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:57.488316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 8/15] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:51:57.494256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.502674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:51:57.508099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.589057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ab0fc-f30d-47f1-8266-ab94754bbc25 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.600023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d74b-5230-47f1-8d0d-3be35a93d901 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.620374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.621242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.621556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.621842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] PATH_INFO: `/v3/users/5b85f3c3beaa4b878ef617b7b044b497` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.623088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=5b85f3c3beaa4b878ef617b7b044b497)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:57.624534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:57.626187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 9/17] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/users/5b85f3c3beaa4b878ef617b7b044b497 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:51:57.630985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.631440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.631771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.632045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.632311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.731925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30e5d-1c94-4d96-ae39-e4b7f5bcb2a0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.757982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:57.759498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:57.765194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.766008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.766286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.766554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.767709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:57.769120 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:57.770995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 10/18] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:51:57.776684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:51:57.780143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:51:57.781158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:51:57.782122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:51:57.782122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:51:57.782122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:51:57.782122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:51:57.782122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 9/19] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:51:57.786883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:57.869052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147757a0-ca5d-4ed4-ad9e-1f3b20c46a0f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.880554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8192083-fd90-45e2-ae4f-195574475aae None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:57.899874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5197556-eaab-4ac9-b9c5-03ae614ca5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.900519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5197556-eaab-4ac9-b9c5-03ae614ca5ab None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.900823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5197556-eaab-4ac9-b9c5-03ae614ca5ab None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.901093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5197556-eaab-4ac9-b9c5-03ae614ca5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.901933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5197556-eaab-4ac9-b9c5-03ae614ca5ab None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.domain.id=default, user.id=5b85f3c3beaa4b878ef617b7b044b497) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:51:57.902241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5197556-eaab-4ac9-b9c5-03ae614ca5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:57.903655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5197556-eaab-4ac9-b9c5-03ae614ca5ab None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:57.910031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 11/20] 10.222.0.69 () {56 vars in 1322 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/role_assignments?user.id=5b85f3c3beaa4b878ef617b7b044b497&scope.domain.id=default&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 233 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:51:57.912556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7244c0-7082-4caf-af72-ba843285b43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:57.913215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7244c0-7082-4caf-af72-ba843285b43a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:57.913535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7244c0-7082-4caf-af72-ba843285b43a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:57.913814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7244c0-7082-4caf-af72-ba843285b43a None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:57.915068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7244c0-7082-4caf-af72-ba843285b43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:51:57.915375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7244c0-7082-4caf-af72-ba843285b43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:57.916790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7244c0-7082-4caf-af72-ba843285b43a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:57.936705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 10/21] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:00.506154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545b56-9a8b-473e-b608-53c09db5a429 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:00.506665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545b56-9a8b-473e-b608-53c09db5a429 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:00.506743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545b56-9a8b-473e-b608-53c09db5a429 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:00.508057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 12/22] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:00.514148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac0eb-2e53-4541-8608-1e4eafd531ab None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:00.514565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac0eb-2e53-4541-8608-1e4eafd531ab None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:00.514733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac0eb-2e53-4541-8608-1e4eafd531ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:00.532355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-177ac0eb-2e53-4541-8608-1e4eafd531ab None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:00.537959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-177ac0eb-2e53-4541-8608-1e4eafd531ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:00.614086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 11/23] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:00.649810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545b56-9a8b-473e-b608-53c09db5a429 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:00.803087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545b56-9a8b-473e-b608-53c09db5a429 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:00.837131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5f514-e36b-4078-890e-d2723b7b81bd None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:00.837664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5f514-e36b-4078-890e-d2723b7b81bd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:00.838108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5f514-e36b-4078-890e-d2723b7b81bd None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:00.839924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 12/24] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:00.844632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:00.845406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dad9e7-4eba-492d-bf7d-60e53a35f932 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:00.845551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:00.845732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:00.845992 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:00.846390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dad9e7-4eba-492d-bf7d-60e53a35f932 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:00.846908 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dad9e7-4eba-492d-bf7d-60e53a35f932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:00.873489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:00.877075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-22dad9e7-4eba-492d-bf7d-60e53a35f932 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:00.878501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-22dad9e7-4eba-492d-bf7d-60e53a35f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:00.878718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:00.879531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:00.880263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 13/25] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:00.890462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:00.994690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 13/26] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:01.032166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dad9e7-4eba-492d-bf7d-60e53a35f932 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.065901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ad355-cb31-40d2-b17f-f71924c1a22b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.100590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaf6fc-dd3f-458d-9732-78a5ab9e7ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.101557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaf6fc-dd3f-458d-9732-78a5ab9e7ec4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.102559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaf6fc-dd3f-458d-9732-78a5ab9e7ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.102981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaf6fc-dd3f-458d-9732-78a5ab9e7ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.103897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaf6fc-dd3f-458d-9732-78a5ab9e7ec4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:01.104357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaf6fc-dd3f-458d-9732-78a5ab9e7ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.105934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaf6fc-dd3f-458d-9732-78a5ab9e7ec4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.114512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 14/27] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:01.115965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d603a5-c74b-4267-8d21-65bb832a355f None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.116415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d603a5-c74b-4267-8d21-65bb832a355f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.116832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d603a5-c74b-4267-8d21-65bb832a355f None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.118640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 15/28] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:01.120477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d603a5-c74b-4267-8d21-65bb832a355f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.139262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dad9e7-4eba-492d-bf7d-60e53a35f932 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.175272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc18b30-9b33-435a-bc4b-ea97d34308c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.176277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc18b30-9b33-435a-bc4b-ea97d34308c5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.176694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc18b30-9b33-435a-bc4b-ea97d34308c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.177100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc18b30-9b33-435a-bc4b-ea97d34308c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.187096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc18b30-9b33-435a-bc4b-ea97d34308c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.188714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc18b30-9b33-435a-bc4b-ea97d34308c5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fcc18b30-9b33-435a-bc4b-ea97d34308c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:52:01.205877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:01.206839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:01.207831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:52:01.207831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:52:01.207831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:52:01.207831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:01.209626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 14/29] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:01.210978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17c1d5-b115-4680-9e70-3bdf64fd1e21 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.211941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17c1d5-b115-4680-9e70-3bdf64fd1e21 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.212351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17c1d5-b115-4680-9e70-3bdf64fd1e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.229111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ae17c1d5-b115-4680-9e70-3bdf64fd1e21 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:01.230498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ae17c1d5-b115-4680-9e70-3bdf64fd1e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:01.240201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d603a5-c74b-4267-8d21-65bb832a355f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.275151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ade47-e413-47f0-9464-139d0bfe7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.276283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ade47-e413-47f0-9464-139d0bfe7063 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.276719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ade47-e413-47f0-9464-139d0bfe7063 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.277136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ade47-e413-47f0-9464-139d0bfe7063 None admin] PATH_INFO: `/v3/users/5b85f3c3beaa4b878ef617b7b044b497` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.278562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ade47-e413-47f0-9464-139d0bfe7063 None admin] RBAC: Authorizing `identity:get_user(user_id=5b85f3c3beaa4b878ef617b7b044b497)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.280160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ade47-e413-47f0-9464-139d0bfe7063 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.282437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 16/30] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:01 2022] GET /identity/v3/users/5b85f3c3beaa4b878ef617b7b044b497 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:01.283883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e33bbd-c6f8-47dc-9d9f-d780ef51c588 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.284384 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e33bbd-c6f8-47dc-9d9f-d780ef51c588 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.284874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e33bbd-c6f8-47dc-9d9f-d780ef51c588 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.286650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 17/31] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:01.292270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e33bbd-c6f8-47dc-9d9f-d780ef51c588 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.297806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 15/32] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:01.298674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17c1d5-b115-4680-9e70-3bdf64fd1e21 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.421647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e33bbd-c6f8-47dc-9d9f-d780ef51c588 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.425480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17c1d5-b115-4680-9e70-3bdf64fd1e21 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.458848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.459807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.460261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.460731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.462236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:01.462734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.464281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.470424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5599df-d1e1-4bf1-a59c-224e8aacd6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.471222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5599df-d1e1-4bf1-a59c-224e8aacd6d8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.471505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5599df-d1e1-4bf1-a59c-224e8aacd6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.471779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5599df-d1e1-4bf1-a59c-224e8aacd6d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.473209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5599df-d1e1-4bf1-a59c-224e8aacd6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.474674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5599df-d1e1-4bf1-a59c-224e8aacd6d8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.477164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 16/33] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:01.478407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccdb4-1d52-4de8-9863-5638abe2d990 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.478694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccdb4-1d52-4de8-9863-5638abe2d990 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.478971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccdb4-1d52-4de8-9863-5638abe2d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.485452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 18/34] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:01.486749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.498672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-05eccdb4-1d52-4de8-9863-5638abe2d990 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:01.499869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-05eccdb4-1d52-4de8-9863-5638abe2d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:01.577591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 17/35] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:01.578520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccdb4-1d52-4de8-9863-5638abe2d990 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.592152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7db31-842e-44fe-b79d-46d907b2b04d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.628525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.629647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.630143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.630656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.631621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.633358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.700735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccdb4-1d52-4de8-9863-5638abe2d990 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.735402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.736460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.736746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.737027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] PATH_INFO: `/v3/domains/default/users/5b85f3c3beaa4b878ef617b7b044b497/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.739340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5b85f3c3beaa4b878ef617b7b044b497, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.740801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.773069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 19/36] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 18:52:01 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:01.775075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.869639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 18/37] 10.222.0.69 () {58 vars in 1361 bytes} [Wed May 4 18:52:01 2022] PUT /identity/v3/domains/default/users/5b85f3c3beaa4b878ef617b7b044b497/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:01.870823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:01.890785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1fe6a-8b00-4ce0-9634-5ad2a236edf1 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:01.930149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a11c6-aa39-41d6-83bc-7abe8d7051da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:01.931268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a11c6-aa39-41d6-83bc-7abe8d7051da None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:01.932362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a11c6-aa39-41d6-83bc-7abe8d7051da None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:01.932855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a11c6-aa39-41d6-83bc-7abe8d7051da None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:01.934113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a11c6-aa39-41d6-83bc-7abe8d7051da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:01.936798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a11c6-aa39-41d6-83bc-7abe8d7051da None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:01.976243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 20/38] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:52:01 2022] POST /identity/v3/projects => generated 301 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:01.988855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4a1f5-ec81-4d16-b5d2-ee8a8cd08124 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:02.030486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b80666-ae4f-4bde-98d8-a2e16ddfadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:02.031777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b80666-ae4f-4bde-98d8-a2e16ddfadb8 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.032255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b80666-ae4f-4bde-98d8-a2e16ddfadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.032729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b80666-ae4f-4bde-98d8-a2e16ddfadb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.033857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b80666-ae4f-4bde-98d8-a2e16ddfadb8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:02.035763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b80666-ae4f-4bde-98d8-a2e16ddfadb8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:02.066664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 18:52:01 2022] POST /identity/v3/roles => generated 219 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:02.156338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c878f-47f9-4f50-b327-3c35cc0c968b None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.156654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c878f-47f9-4f50-b327-3c35cc0c968b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.156903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c878f-47f9-4f50-b327-3c35cc0c968b None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.158575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 21/40] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:02.166015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060422-98c2-47f0-a3a8-73ce31d14ee2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.166698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060422-98c2-47f0-a3a8-73ce31d14ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.167171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060422-98c2-47f0-a3a8-73ce31d14ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.187165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a5060422-98c2-47f0-a3a8-73ce31d14ee2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:02.189071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a5060422-98c2-47f0-a3a8-73ce31d14ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:02.273795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 20/41] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:02.298433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c878f-47f9-4f50-b327-3c35cc0c968b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:02.398575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b708-42f7-4c39-a1b8-84460a1a148a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.399803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b708-42f7-4c39-a1b8-84460a1a148a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.400293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b708-42f7-4c39-a1b8-84460a1a148a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.401924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 21/42] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:02.408397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b42f3-1f06-4bff-97a4-e6106055717b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.408686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b42f3-1f06-4bff-97a4-e6106055717b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.408971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b42f3-1f06-4bff-97a4-e6106055717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.421641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c878f-47f9-4f50-b327-3c35cc0c968b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:02.431475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b21b42f3-1f06-4bff-97a4-e6106055717b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:02.433072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b21b42f3-1f06-4bff-97a4-e6106055717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:02.468146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:02.468146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.468146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.468468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.470182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:02.471645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:02.473282 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 22/43] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:02.478802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:02.523423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 22/44] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:02.548619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b42f3-1f06-4bff-97a4-e6106055717b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:02.592508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526581-2126-4d47-bace-53ab21dc122e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:02.626091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a577e-ddd7-4eef-9e6c-a5f073a6c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:02.626770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a577e-ddd7-4eef-9e6c-a5f073a6c2a5 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.627059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a577e-ddd7-4eef-9e6c-a5f073a6c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.627336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a577e-ddd7-4eef-9e6c-a5f073a6c2a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.628043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a577e-ddd7-4eef-9e6c-a5f073a6c2a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:02.629521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a577e-ddd7-4eef-9e6c-a5f073a6c2a5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:02.650736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b42f3-1f06-4bff-97a4-e6106055717b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:02.654377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 23/45] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:52:02 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:02.690295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116b1f8-3306-41d9-8925-84eb87245907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:02.690983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116b1f8-3306-41d9-8925-84eb87245907 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:02.691265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116b1f8-3306-41d9-8925-84eb87245907 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:02.691541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116b1f8-3306-41d9-8925-84eb87245907 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:02.692326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116b1f8-3306-41d9-8925-84eb87245907 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:02.693792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116b1f8-3306-41d9-8925-84eb87245907 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:02.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 23/46] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 18:52:02 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:04.354948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b5d1-92d9-4443-96a4-5ec56df12def None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:04.355488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b5d1-92d9-4443-96a4-5ec56df12def None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:04.355488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b5d1-92d9-4443-96a4-5ec56df12def None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:04.356861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 24/47] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:04.361905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b781e6-09df-48de-a8ef-dab4fd01b911 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:04.362316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b781e6-09df-48de-a8ef-dab4fd01b911 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:04.362473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b781e6-09df-48de-a8ef-dab4fd01b911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:04.380232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-87b781e6-09df-48de-a8ef-dab4fd01b911 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:04.381418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-87b781e6-09df-48de-a8ef-dab4fd01b911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:04.445687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 24/48] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:04.468395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7b5d1-92d9-4443-96a4-5ec56df12def None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:04.568870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7b5d1-92d9-4443-96a4-5ec56df12def None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:04.599841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:04.600632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:04.600913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:04.601186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:04.611233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:04.619230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:04.620141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:04.620892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 25/49] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:04.626149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b781e6-09df-48de-a8ef-dab4fd01b911 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:04.716348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b781e6-09df-48de-a8ef-dab4fd01b911 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:04.749231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:04.749954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:04.750234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:04.750503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:04.751263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:04.751568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:04.752982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:04.766133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 25/50] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:04.772474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:04.873334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b75ea3-1e32-4c96-a4d6-8d7ae428fb13 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:04.905982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3976ff-87d8-4b33-8ad9-19d97cc6799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:04.906857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3976ff-87d8-4b33-8ad9-19d97cc6799d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:04.907141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3976ff-87d8-4b33-8ad9-19d97cc6799d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:04.907418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3976ff-87d8-4b33-8ad9-19d97cc6799d None admin] PATH_INFO: `/v3/users/5b85f3c3beaa4b878ef617b7b044b497` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:04.908600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3976ff-87d8-4b33-8ad9-19d97cc6799d None admin] RBAC: Authorizing `identity:get_user(user_id=5b85f3c3beaa4b878ef617b7b044b497)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:04.910088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3976ff-87d8-4b33-8ad9-19d97cc6799d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:04.911711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 26/51] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:04 2022] GET /identity/v3/users/5b85f3c3beaa4b878ef617b7b044b497 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:04.917725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:04.936109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd1745-748f-4bb9-a8ac-6c4125f590ab None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:04.936400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd1745-748f-4bb9-a8ac-6c4125f590ab None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:04.936682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd1745-748f-4bb9-a8ac-6c4125f590ab None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:04.938058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 27/52] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:04.942919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b30c5-7898-41c3-9a1d-5cd27319edd2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:04.943211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b30c5-7898-41c3-9a1d-5cd27319edd2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:04.943489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b30c5-7898-41c3-9a1d-5cd27319edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:04.959493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f74b30c5-7898-41c3-9a1d-5cd27319edd2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:04.961599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f74b30c5-7898-41c3-9a1d-5cd27319edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:05.012333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391ea6c-70c5-4dd0-856f-a1dc0e634e62 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:05.025664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 28/53] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:05.044685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:05.045483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:05.045784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:05.046061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:05.047215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:05.048655 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:05.049031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b30c5-7898-41c3-9a1d-5cd27319edd2 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:05.050305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 26/54] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:05.055931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:05.139707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b30c5-7898-41c3-9a1d-5cd27319edd2 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:05.146773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb8732-f976-47ef-98b0-1ad3072f0533 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:05.171749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:05.172541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:05.172832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:05.173110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:05.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:05.175759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:05.177366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 29/55] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:05.179068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3b1e7-97fe-4b8c-8d77-72d440033961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:05.179718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3b1e7-97fe-4b8c-8d77-72d440033961 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:05.180030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3b1e7-97fe-4b8c-8d77-72d440033961 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:05.180308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3b1e7-97fe-4b8c-8d77-72d440033961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:05.181140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3b1e7-97fe-4b8c-8d77-72d440033961 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.domain.id=default, user.id=5b85f3c3beaa4b878ef617b7b044b497) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:05.181451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3b1e7-97fe-4b8c-8d77-72d440033961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:05.182883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:05.182985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3b1e7-97fe-4b8c-8d77-72d440033961 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:05.190849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 27/56] 10.222.0.69 () {56 vars in 1322 bytes} [Wed May 4 18:52:05 2022] GET /identity/v3/role_assignments?user.id=5b85f3c3beaa4b878ef617b7b044b497&scope.domain.id=default&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 530 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:05.286336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1ed9-ab5b-4a92-9b2b-a16e8e8f2ea0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:05.322415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286e2bf-7169-4ef6-b0b2-630da5b79a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:05.323092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e2bf-7169-4ef6-b0b2-630da5b79a93 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:05.323380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e2bf-7169-4ef6-b0b2-630da5b79a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:05.323657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e2bf-7169-4ef6-b0b2-630da5b79a93 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:05.324375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286e2bf-7169-4ef6-b0b2-630da5b79a93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:05.325900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286e2bf-7169-4ef6-b0b2-630da5b79a93 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:05.352135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 30/57] 10.222.0.69 () {60 vars in 1140 bytes} [Wed May 4 18:52:05 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:52:07.582974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd4a4f-1573-4296-986d-f0769fc635f2 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:07.583484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd4a4f-1573-4296-986d-f0769fc635f2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:07.583588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd4a4f-1573-4296-986d-f0769fc635f2 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:07.584889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 28/58] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:07.589982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441d82-ff38-4a63-a59e-ee13bd67942b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:07.590389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441d82-ff38-4a63-a59e-ee13bd67942b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:07.590547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441d82-ff38-4a63-a59e-ee13bd67942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:07.607068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c4441d82-ff38-4a63-a59e-ee13bd67942b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:07.608248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c4441d82-ff38-4a63-a59e-ee13bd67942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:07.670109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 31/59] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:07.694739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd4a4f-1573-4296-986d-f0769fc635f2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:07.788568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd4a4f-1573-4296-986d-f0769fc635f2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:07.819204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2e22-706a-45e0-82ed-9caddb8748b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:07.819969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2e22-706a-45e0-82ed-9caddb8748b0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:07.820251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2e22-706a-45e0-82ed-9caddb8748b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:07.820709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2e22-706a-45e0-82ed-9caddb8748b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:07.822654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2e22-706a-45e0-82ed-9caddb8748b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:07.825313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2e22-706a-45e0-82ed-9caddb8748b0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:07.827323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 29/60] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:07.833595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4441d82-ff38-4a63-a59e-ee13bd67942b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:07.930377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4441d82-ff38-4a63-a59e-ee13bd67942b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:07.961876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b4f3-05c7-401b-828c-a6babe585de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:07.962540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b4f3-05c7-401b-828c-a6babe585de9 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:07.962824 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b4f3-05c7-401b-828c-a6babe585de9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:07.963097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b4f3-05c7-401b-828c-a6babe585de9 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:07.964062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b4f3-05c7-401b-828c-a6babe585de9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:07.965546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b4f3-05c7-401b-828c-a6babe585de9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:07.990908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 32/61] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:52:07 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:11.324392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142745-0892-4c1f-ac9c-3a78edc073c8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.325296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142745-0892-4c1f-ac9c-3a78edc073c8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.325784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142745-0892-4c1f-ac9c-3a78edc073c8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.327693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 30/62] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:11.333850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8b2a1-04d0-4dda-9be6-a73a0b8ef573 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.334841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8b2a1-04d0-4dda-9be6-a73a0b8ef573 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.335319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8b2a1-04d0-4dda-9be6-a73a0b8ef573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.362560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3ba8b2a1-04d0-4dda-9be6-a73a0b8ef573 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:11.364121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3ba8b2a1-04d0-4dda-9be6-a73a0b8ef573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:11.459675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 33/63] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:11.483235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd142745-0892-4c1f-ac9c-3a78edc073c8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:11.536363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a31ca-ce5f-4588-97dc-953bf45e934a None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.537009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a31ca-ce5f-4588-97dc-953bf45e934a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.537500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a31ca-ce5f-4588-97dc-953bf45e934a None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.539113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 34/64] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:11.545026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be52cf7-3f16-4be4-848e-1a8e5300a938 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.545659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be52cf7-3f16-4be4-848e-1a8e5300a938 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.546136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be52cf7-3f16-4be4-848e-1a8e5300a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.575672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6be52cf7-3f16-4be4-848e-1a8e5300a938 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:11.577138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6be52cf7-3f16-4be4-848e-1a8e5300a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:11.610162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd142745-0892-4c1f-ac9c-3a78edc073c8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:11.643832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:11.645005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.645818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.646283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.658916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:11.665562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 35/65] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:11.667183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd47b8-c47b-4d08-8cfc-ab8156e99187 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.667613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd47b8-c47b-4d08-8cfc-ab8156e99187 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.668027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd47b8-c47b-4d08-8cfc-ab8156e99187 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:11.668389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:11.669213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:11.670090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:11.670653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 36/66] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:11.672671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 31/67] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:11.674668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125050a3-23f3-4fe0-aea0-26289d18d8a5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.675113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125050a3-23f3-4fe0-aea0-26289d18d8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.675517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125050a3-23f3-4fe0-aea0-26289d18d8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.678382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:11.706316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-125050a3-23f3-4fe0-aea0-26289d18d8a5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:11.707802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-125050a3-23f3-4fe0-aea0-26289d18d8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:11.785430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 37/68] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:11.787020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125050a3-23f3-4fe0-aea0-26289d18d8a5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:11.821710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb926f-5dd6-4102-b5d7-224199c4c0f7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:11.855128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:11.855726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.856011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.856288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.857037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:11.857346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:11.858767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:11.867864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 32/69] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:11.868712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:11.894783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125050a3-23f3-4fe0-aea0-26289d18d8a5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:11.928879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:11.930320 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:11.930601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:11.930877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:11.941247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:11.949336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:11.950225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:11.950967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:11.955537 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 38/70] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:11.956398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:11.972724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2fbab-79a7-4cfd-9781-d134bfc25c51 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.009671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.010609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.010893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.011169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.023679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:12.031353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:12.032286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:12.033206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 33/71] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:12.033965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.070878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e36bed-6471-47ae-8f5a-dc4ef00ef4ad None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.103684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa6713-1967-457a-bc00-b25e01670ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.104557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa6713-1967-457a-bc00-b25e01670ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.104840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa6713-1967-457a-bc00-b25e01670ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.105114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa6713-1967-457a-bc00-b25e01670ef9 None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.118481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa6713-1967-457a-bc00-b25e01670ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.119883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa6713-1967-457a-bc00-b25e01670ef9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.121891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 39/72] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:11 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:12.123139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b7fbe-caee-48da-bac1-1cf973bd35d3 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.123433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b7fbe-caee-48da-bac1-1cf973bd35d3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.123707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b7fbe-caee-48da-bac1-1cf973bd35d3 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.125074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 40/73] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:12.129697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b7fbe-caee-48da-bac1-1cf973bd35d3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.133433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924300-8a41-4005-aec6-b12dfa030b2b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.165839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.166504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.166785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.167057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.167823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:12.168132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.169535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.177593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 34/74] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:12.178385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.231004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b7fbe-caee-48da-bac1-1cf973bd35d3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.262943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4a59a-1421-4035-b866-b4e082369574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.263599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4a59a-1421-4035-b866-b4e082369574 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.263876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4a59a-1421-4035-b866-b4e082369574 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.264155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4a59a-1421-4035-b866-b4e082369574 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.264883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4a59a-1421-4035-b866-b4e082369574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:12.265190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4a59a-1421-4035-b866-b4e082369574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.266588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4a59a-1421-4035-b866-b4e082369574 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.275081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 41/75] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:12.276230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a669fd-5522-4069-a735-fbdadb6cb944 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.276512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a669fd-5522-4069-a735-fbdadb6cb944 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.276785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a669fd-5522-4069-a735-fbdadb6cb944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.283026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149a2a-7065-4226-99c9-0860ad2f6110 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.296173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-29a669fd-5522-4069-a735-fbdadb6cb944 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:12.297345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-29a669fd-5522-4069-a735-fbdadb6cb944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:12.314521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.315156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.315431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.315701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.359170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 42/76] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:12.360470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e1a12-a1e1-4d09-b55c-77c4e47f3613 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.360754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e1a12-a1e1-4d09-b55c-77c4e47f3613 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.361030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e1a12-a1e1-4d09-b55c-77c4e47f3613 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.362478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 43/77] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:12.365087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e1a12-a1e1-4d09-b55c-77c4e47f3613 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.379076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.380551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.473048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 35/78] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:12.473911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.479090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e1a12-a1e1-4d09-b55c-77c4e47f3613 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.513566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc29f4-053a-4742-ad55-1d56b89201fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.514435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc29f4-053a-4742-ad55-1d56b89201fe None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.514719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc29f4-053a-4742-ad55-1d56b89201fe None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.514997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc29f4-053a-4742-ad55-1d56b89201fe None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.516171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc29f4-053a-4742-ad55-1d56b89201fe None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.517656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc29f4-053a-4742-ad55-1d56b89201fe None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.519297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 44/79] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:12.520672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b601-9d8a-4b4c-a8c6-1e9e6001f29e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.520962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b601-9d8a-4b4c-a8c6-1e9e6001f29e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.521262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b601-9d8a-4b4c-a8c6-1e9e6001f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.536482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6d01b601-9d8a-4b4c-a8c6-1e9e6001f29e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:12.537689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6d01b601-9d8a-4b4c-a8c6-1e9e6001f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:12.566256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960e90-6853-43d0-b6dc-0661947e1ed4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.597135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.598020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.598304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.598569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] PATH_INFO: `/v3/users/5b85f3c3beaa4b878ef617b7b044b497` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.599562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 45/80] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:12.599722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] RBAC: Authorizing `identity:get_user(user_id=5b85f3c3beaa4b878ef617b7b044b497)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.600380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b601-9d8a-4b4c-a8c6-1e9e6001f29e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.601168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.602997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 36/81] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/users/5b85f3c3beaa4b878ef617b7b044b497 => generated 247 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:12.603568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.695007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b601-9d8a-4b4c-a8c6-1e9e6001f29e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.696738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e821359-8305-4f32-9030-0e1ca7e4dc48 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.728288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.728566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.729079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.729362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.729481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.729667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.729765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.729979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.731164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.732591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.734488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 37/82] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:12.735075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.744534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:12.752238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:12.753089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:12.753888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 46/83] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:12.754540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:12.834970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66e409-cb9d-496b-8b53-72476720e0a4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.845186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adf0bf-8b3f-4de6-a688-9507e963d980 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:12.866304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.866938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.867792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.868066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.876642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:12.877276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:12.877590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:12.877868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:12.930426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.931865 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:12.939545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:12.940997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.024076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 38/84] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:13.024920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.036638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 47/85] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:13.037491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.116764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9750-af83-4099-ab03-9d0284a52793 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.128554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2633e8-ce13-4c9a-9d15-6bc6a9669512 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.149597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.150415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.150699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.150976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.152174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.153648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.155255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 39/86] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.156010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.161494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.162152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.162441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.162718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.163545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=c8a713a9aefa4037914c8eafea80ab1a) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:13.163879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.165308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.170590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 48/87] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/role_assignments?user.id=c8a713a9aefa4037914c8eafea80ab1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.171415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.262032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb745eb-a7ce-40c7-9a4d-f3fa28afe594 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.281623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba05c-2fc5-48f1-8e59-5dad945f652e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.297546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.298231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.298514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.298790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.299551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:13.299860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.301309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.315288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 40/88] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.315288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.322471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.323356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.323640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.323918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.325142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.326692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.328497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 49/89] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.329292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.418718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf35c7-d435-4fb6-92ad-5e6886aa7f95 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.429089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45909be-14d5-407b-876c-591dc38672f3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.450771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.451632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.451926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.452179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.453365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.454823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.461165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 41/90] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.461165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.464464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.465235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.465548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.465838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.466608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.468110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.497954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 50/91] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:52:13 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:13.499284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.567804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ee0b8-2fcc-48f0-842f-941f75cae324 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.608768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.610551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.611401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.612049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.614063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.616633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.625515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 42/92] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.626834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.641208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7327d0-a018-46d7-b84b-1578e19a3835 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.682480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.683185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.683407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.683685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.685573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] RBAC: Adding query filter params (role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=c8a713a9aefa4037914c8eafea80ab1a) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:13.685573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.686309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.693985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 51/93] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/role_assignments?user.id=c8a713a9aefa4037914c8eafea80ab1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.694787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:13.760561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906168-dc95-4145-9573-45bd1193acac None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.811156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.812801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.813316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.813827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.815435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=5b85f3c3beaa4b878ef617b7b044b497) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:13.816190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.819580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567fb9d-e80f-4245-b7d0-9a6e61fd4aa0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:13.821431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:13.829296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 43/94] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/role_assignments?user.id=5b85f3c3beaa4b878ef617b7b044b497&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:13.864389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:13.865073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:13.865362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:13.865687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:13.948715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:13.950253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:14.059800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 52/95] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:14.065643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:14.185361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06298857-14a6-46b6-b187-d34a9eb4163d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:14.234187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899144b-df65-4e69-83c7-47206e485d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:14.235059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899144b-df65-4e69-83c7-47206e485d2b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:14.235345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899144b-df65-4e69-83c7-47206e485d2b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:14.235619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899144b-df65-4e69-83c7-47206e485d2b None admin] PATH_INFO: `/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:14.236847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899144b-df65-4e69-83c7-47206e485d2b None admin] RBAC: Authorizing `identity:get_project(project_id=b5223adcafb24bbbb268d46ea08ceaa4)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:14.238340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899144b-df65-4e69-83c7-47206e485d2b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:14.240233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 44/96] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:14 2022] GET /identity/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:14.247978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:14.381816 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b867dd-bf50-4a6f-afb6-d6f8c65dfb7d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:14.420767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056db6-7b48-439a-88ad-ffe43649d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:14.421454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056db6-7b48-439a-88ad-ffe43649d452 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:14.421761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056db6-7b48-439a-88ad-ffe43649d452 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:14.422041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056db6-7b48-439a-88ad-ffe43649d452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:14.422884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96056db6-7b48-439a-88ad-ffe43649d452 None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=b5223adcafb24bbbb268d46ea08ceaa4, user.id=c8a713a9aefa4037914c8eafea80ab1a) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:14.423196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96056db6-7b48-439a-88ad-ffe43649d452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:14.424652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96056db6-7b48-439a-88ad-ffe43649d452 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:14.431747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 53/97] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:14 2022] GET /identity/v3/role_assignments?user.id=c8a713a9aefa4037914c8eafea80ab1a&scope.project.id=b5223adcafb24bbbb268d46ea08ceaa4&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:16.424932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae167d-e4f5-4688-829c-e16ca932c9cf None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:16.425443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae167d-e4f5-4688-829c-e16ca932c9cf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:16.425540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae167d-e4f5-4688-829c-e16ca932c9cf None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:16.427161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 45/98] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:16.432207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea303-a240-444f-9de4-e67c7dcd088a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:16.432631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea303-a240-444f-9de4-e67c7dcd088a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:16.432820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea303-a240-444f-9de4-e67c7dcd088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:16.455436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-be1ea303-a240-444f-9de4-e67c7dcd088a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:16.456612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-be1ea303-a240-444f-9de4-e67c7dcd088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:16.545885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b779b-a12b-4214-a422-c5fe5c94593d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:16.546197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b779b-a12b-4214-a422-c5fe5c94593d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:16.546446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b779b-a12b-4214-a422-c5fe5c94593d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:16.547057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 54/99] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:16.547814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 46/100] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:16.553198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78364b-9de2-418b-98ff-4cb7a6477550 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:16.553504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78364b-9de2-418b-98ff-4cb7a6477550 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:16.553793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78364b-9de2-418b-98ff-4cb7a6477550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:16.573833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-fe78364b-9de2-418b-98ff-4cb7a6477550 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:16.575038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-fe78364b-9de2-418b-98ff-4cb7a6477550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:16.584846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b779b-a12b-4214-a422-c5fe5c94593d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:16.696702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 55/101] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:16.698048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816df7a-e202-4ece-8d19-34e0c98da2fe None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:16.698333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816df7a-e202-4ece-8d19-34e0c98da2fe None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:16.698611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816df7a-e202-4ece-8d19-34e0c98da2fe None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:16.699905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 56/102] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:16.709855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64f8e-3c41-45a5-94ee-58382c53c37f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:16.710155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64f8e-3c41-45a5-94ee-58382c53c37f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:16.710411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64f8e-3c41-45a5-94ee-58382c53c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:16.742814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b779b-a12b-4214-a422-c5fe5c94593d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:16.754512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a0c64f8e-3c41-45a5-94ee-58382c53c37f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:16.755730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a0c64f8e-3c41-45a5-94ee-58382c53c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:16.783152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:16.783969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:16.784251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:16.784524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:16.806270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:16.826463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:16.827360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 47/103] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:16.828117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:16.876003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 57/104] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:16.876868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c64f8e-3c41-45a5-94ee-58382c53c37f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:16.969579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9412b-6701-4cfe-b97e-bf74ea8fdd7a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.011395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.012206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.012489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.012764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.031072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:17.048585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:17.049515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:17.050289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 48/105] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:17.051403 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.051505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c64f8e-3c41-45a5-94ee-58382c53c37f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.094188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.094871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.095156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.095432 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.096183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:17.096490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.097906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.113515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 58/106] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.114218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.166991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad3a0-8e35-4e82-9f64-8e327d3c9ad1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.212320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.213181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.213482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.213764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.228426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff073357-350f-4141-a46e-b80a8c405216 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.231096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:17.247965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:17.250087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 49/107] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:17.251979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.274190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.274879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.275164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.275440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.276189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:17.276498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.277910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.290833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 59/108] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.291498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.355583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0104-11bc-480e-b78a-897015cb5581 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.390728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.391676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.391889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.392197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.393398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.394887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.396795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 50/109] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.397582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.428648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e0ba-ca95-4338-9866-4bab7b98b8e0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.465157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76d931-cc02-4668-89e1-37f9388cb25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.465934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d931-cc02-4668-89e1-37f9388cb25e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.466133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d931-cc02-4668-89e1-37f9388cb25e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.466408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d931-cc02-4668-89e1-37f9388cb25e None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.467147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d931-cc02-4668-89e1-37f9388cb25e None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:17.467454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d931-cc02-4668-89e1-37f9388cb25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.468845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d931-cc02-4668-89e1-37f9388cb25e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.476977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 60/110] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.478261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417841-da2c-4ac5-8b0e-ab7646ecb5a2 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.478601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417841-da2c-4ac5-8b0e-ab7646ecb5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.478828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417841-da2c-4ac5-8b0e-ab7646ecb5a2 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.483925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 61/111] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:17.483925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da34d53-bdfb-4649-9f6c-64ac1b477958 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.483925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da34d53-bdfb-4649-9f6c-64ac1b477958 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.483925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da34d53-bdfb-4649-9f6c-64ac1b477958 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.485601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 62/112] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:17.487166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da34d53-bdfb-4649-9f6c-64ac1b477958 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.501882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335def0-dbac-44cb-8819-f679c8f6ae4b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.539868 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.541199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.541510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.541796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] PATH_INFO: `/v3/users/5b85f3c3beaa4b878ef617b7b044b497` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.543166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] RBAC: Authorizing `identity:get_user(user_id=5b85f3c3beaa4b878ef617b7b044b497)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.544610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.546379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 51/113] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/users/5b85f3c3beaa4b878ef617b7b044b497 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.547049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.594046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da34d53-bdfb-4649-9f6c-64ac1b477958 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.627444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff8d9-1d5c-4a0d-a7ac-d060c23acf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.628321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff8d9-1d5c-4a0d-a7ac-d060c23acf52 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.628601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff8d9-1d5c-4a0d-a7ac-d060c23acf52 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.628875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff8d9-1d5c-4a0d-a7ac-d060c23acf52 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.630129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff8d9-1d5c-4a0d-a7ac-d060c23acf52 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.631750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff8d9-1d5c-4a0d-a7ac-d060c23acf52 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.634001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 63/114] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.635001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93a3d-c73d-46ab-8ed1-fda69fef2b51 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.635322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93a3d-c73d-46ab-8ed1-fda69fef2b51 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.635587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93a3d-c73d-46ab-8ed1-fda69fef2b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.651654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d6743-3daa-4455-8eb1-0a35e647be85 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.652809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-87b93a3d-c73d-46ab-8ed1-fda69fef2b51 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:17.654019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-87b93a3d-c73d-46ab-8ed1-fda69fef2b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:17.683481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe1f2b-cc99-493c-b586-e1bfaa46ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.684349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1f2b-cc99-493c-b586-e1bfaa46ede9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.684631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1f2b-cc99-493c-b586-e1bfaa46ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.684903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1f2b-cc99-493c-b586-e1bfaa46ede9 None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.686106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe1f2b-cc99-493c-b586-e1bfaa46ede9 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.687529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe1f2b-cc99-493c-b586-e1bfaa46ede9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.694479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 52/115] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.694479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e20c1-7c9a-4248-8593-d0bf564a3361 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.694479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e20c1-7c9a-4248-8593-d0bf564a3361 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.694479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e20c1-7c9a-4248-8593-d0bf564a3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.711681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a97e20c1-7c9a-4248-8593-d0bf564a3361 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:17.712900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a97e20c1-7c9a-4248-8593-d0bf564a3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:17.733616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 64/116] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:17.733616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b93a3d-c73d-46ab-8ed1-fda69fef2b51 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.780433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 53/117] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:17.786386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e20c1-7c9a-4248-8593-d0bf564a3361 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.845966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b93a3d-c73d-46ab-8ed1-fda69fef2b51 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.879725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.880672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.881029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.881356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.883164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.884387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e20c1-7c9a-4248-8593-d0bf564a3361 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:17.884607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.891128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 65/118] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:17.891128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:17.921965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:17.922847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:17.923131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:17.923400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89/users/c8a713a9aefa4037914c8eafea80ab1a/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:17.925578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] RBAC: Authorizing `identity:create_grant(project_id=4bed9b3587c1435482592b924abd1a89, user_id=c8a713a9aefa4037914c8eafea80ab1a, role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:17.927019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:17.939261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 54/119] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:17 2022] PUT /identity/v3/projects/4bed9b3587c1435482592b924abd1a89/users/c8a713a9aefa4037914c8eafea80ab1a/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:17.940040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.002997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0b12-3b65-42ff-afe6-6e127435afe0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.039502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.040408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.040682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.040959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.042248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.043722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:18.051020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 66/120] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:18.051020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.060707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b652bdc-ee50-4725-8bd8-72c6f1d5ec8b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.096167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.096975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.097257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.097562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.098780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.100239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:18.102469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 55/121] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:18.107501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.150791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d65d1-987f-4887-ba8e-29cd8e9baa56 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.185314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862043-a775-4d36-852d-aa9db6e5935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.186148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862043-a775-4d36-852d-aa9db6e5935c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.186430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862043-a775-4d36-852d-aa9db6e5935c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.186706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862043-a775-4d36-852d-aa9db6e5935c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.196787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c862043-a775-4d36-852d-aa9db6e5935c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-1c862043-a775-4d36-852d-aa9db6e5935c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:18.204581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:18.205599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:18.206356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 67/122] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:18.207363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5977-7480-436c-8ab7-408a2ce6d674 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.207363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5977-7480-436c-8ab7-408a2ce6d674 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.207593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5977-7480-436c-8ab7-408a2ce6d674 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.208959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 68/123] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:18.213664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5977-7480-436c-8ab7-408a2ce6d674 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.221383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ac39e-0125-421d-9283-290534b3b8af None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.256707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.257586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.257870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.258144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89/users/5b85f3c3beaa4b878ef617b7b044b497/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.260091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] RBAC: Authorizing `identity:create_grant(project_id=4bed9b3587c1435482592b924abd1a89, user_id=5b85f3c3beaa4b878ef617b7b044b497, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.261547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:18.285494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 56/124] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:18 2022] PUT /identity/v3/projects/4bed9b3587c1435482592b924abd1a89/users/5b85f3c3beaa4b878ef617b7b044b497/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:18.285494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.323197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5977-7480-436c-8ab7-408a2ce6d674 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.371455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.373254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.373572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.373856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89/users/c8a713a9aefa4037914c8eafea80ab1a/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.375950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bed9b3587c1435482592b924abd1a89, user_id=c8a713a9aefa4037914c8eafea80ab1a, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.378021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:18.398779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 69/125] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:18 2022] PUT /identity/v3/projects/4bed9b3587c1435482592b924abd1a89/users/c8a713a9aefa4037914c8eafea80ab1a/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:18.399433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.407151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022116-fe97-4f6e-b220-03fc61ed38bb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.446382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392187bf-f877-4b91-a81f-181bda5d4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.447214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392187bf-f877-4b91-a81f-181bda5d4f88 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.447549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392187bf-f877-4b91-a81f-181bda5d4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.447830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392187bf-f877-4b91-a81f-181bda5d4f88 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.448597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392187bf-f877-4b91-a81f-181bda5d4f88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.450109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392187bf-f877-4b91-a81f-181bda5d4f88 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:18.482641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 57/126] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:52:18 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:18.484532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883d13-9474-4990-b95e-380e30acae2d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.485177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883d13-9474-4990-b95e-380e30acae2d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.485594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883d13-9474-4990-b95e-380e30acae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.504479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-aa883d13-9474-4990-b95e-380e30acae2d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:18.505821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-aa883d13-9474-4990-b95e-380e30acae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:18.521340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254c7fb-bf13-48d5-9f68-4f85f67c3de9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.559683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.560391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.560674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.560951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.561769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:18.562083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.563502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:18.573228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 70/127] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:18.579502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.586817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 58/128] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:18.613254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa883d13-9474-4990-b95e-380e30acae2d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.692373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c51f7-2404-4fa9-ae74-a5e29caa9858 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.722607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa883d13-9474-4990-b95e-380e30acae2d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.728844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.729770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.730054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.730334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] PATH_INFO: `/v3/users/540846e3ec7f44bbb517e770cf1fc28b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.744752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] RBAC: Authorizing `identity:get_user(user_id=540846e3ec7f44bbb517e770cf1fc28b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.746261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:18.748012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 71/129] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:18 2022] GET /identity/v3/users/540846e3ec7f44bbb517e770cf1fc28b => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:18.753825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.762326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.763478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.763962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.764466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.776590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:18.784724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:18.785654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:18.786468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:18.789211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 59/130] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:18.798405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:18.859656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba7bab-22c2-4a53-98f6-6292613124d8 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.901492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:18.901492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:18.901492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:18.901492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:18.953821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9560b8-38e2-4d57-ab56-84cb4ee502fd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:18.975253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:18.976618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:19.004006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:19.005059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:19.005620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:19.006114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:19.007073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:19.008117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:19.009747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:19.019390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 60/131] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:19.026554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:19.077164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 72/132] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:52:19.082777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:19.199576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15affe-0713-4bd8-8ff1-9e62e69eb872 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:19.232801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857bfc5-24e0-494c-896d-5976e9d666fe None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:19.267092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:19.267979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:19.268255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:19.268531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:19.269704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:19.271029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:19.271495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:19.271924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:19.273296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:19.274182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:19.275100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:19.275640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:19.277114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 73/133] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:19 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:19.277241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 61/134] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:19 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:19.282660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:19.283666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:19.399972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c4e00-7316-43d4-b7cb-5fe528c5affc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:19.436832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:19.437794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:19.439169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:19.439592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:19.440572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] RBAC: Adding query filter params (role.id=2dad68677730476daa6171ba3da694aa, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=540846e3ec7f44bbb517e770cf1fc28b) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:19.441194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:19.443901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:19.454034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 74/135] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:19 2022] GET /identity/v3/role_assignments?user.id=540846e3ec7f44bbb517e770cf1fc28b&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=2dad68677730476daa6171ba3da694aa => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:19.460044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337a8a3-f4e5-4467-a26e-617876640788 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:19.495886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd96c47-7700-4099-b982-f5163827185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:19.497255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd96c47-7700-4099-b982-f5163827185d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:19.497901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd96c47-7700-4099-b982-f5163827185d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:19.498377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd96c47-7700-4099-b982-f5163827185d None admin] PATH_INFO: `/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:19.500158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd96c47-7700-4099-b982-f5163827185d None admin] RBAC: Authorizing `identity:get_project(project_id=b5223adcafb24bbbb268d46ea08ceaa4)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:19.502036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd96c47-7700-4099-b982-f5163827185d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:19.504120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 62/136] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:19 2022] GET /identity/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:19.510710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:19.670961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7fe7-240b-4e17-ba39-0a9332455043 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:19.721367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d037-8f42-475d-bf77-6b06b4c1f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:19.722368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d037-8f42-475d-bf77-6b06b4c1f85c None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:19.722654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d037-8f42-475d-bf77-6b06b4c1f85c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:19.722927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d037-8f42-475d-bf77-6b06b4c1f85c None admin] PATH_INFO: `/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4/users/c8a713a9aefa4037914c8eafea80ab1a/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:19.724915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8d037-8f42-475d-bf77-6b06b4c1f85c None admin] RBAC: Authorizing `identity:create_grant(project_id=b5223adcafb24bbbb268d46ea08ceaa4, user_id=c8a713a9aefa4037914c8eafea80ab1a, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:19.726480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8d037-8f42-475d-bf77-6b06b4c1f85c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:19.759036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 75/137] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:19 2022] PUT /identity/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4/users/c8a713a9aefa4037914c8eafea80ab1a/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:20.940860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6858-0447-4af2-a140-bf6a579669f2 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:20.941399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6858-0447-4af2-a140-bf6a579669f2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:20.941399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6858-0447-4af2-a140-bf6a579669f2 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:20.942814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 63/138] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:20.948329 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ce82-316d-4753-bdaa-807997d92e50 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:20.948755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ce82-316d-4753-bdaa-807997d92e50 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:20.948949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ce82-316d-4753-bdaa-807997d92e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:20.965811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0c97ce82-316d-4753-bdaa-807997d92e50 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:20.966982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0c97ce82-316d-4753-bdaa-807997d92e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:21.041577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 76/139] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:21.064116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6858-0447-4af2-a140-bf6a579669f2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:21.168463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6858-0447-4af2-a140-bf6a579669f2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:21.203151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:21.203880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:21.204154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:21.204477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:21.214822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:21.223416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:21.224305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:21.225089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 64/140] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:21.231227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ce82-316d-4753-bdaa-807997d92e50 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:21.333876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ce82-316d-4753-bdaa-807997d92e50 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:21.368588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:21.369255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:21.369571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:21.369847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:21.370588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:21.370889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:21.372265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:21.380520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 77/141] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:21.386103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:21.487919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336684c2-f3fd-4f8d-a636-c49b6d3649ad None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:21.521660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:21.522621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:21.523417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:21.523700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:21.524928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:21.526398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:21.528024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 65/142] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:21 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:21.533842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:21.635864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169a2df-9d02-451d-8011-274bd7c482a7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:21.675558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c2ada-643d-427b-b034-7542190db268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:21.676230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2ada-643d-427b-b034-7542190db268 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:21.676510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2ada-643d-427b-b034-7542190db268 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:21.676843 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2ada-643d-427b-b034-7542190db268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:21.747989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c2ada-643d-427b-b034-7542190db268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:21.749390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c2ada-643d-427b-b034-7542190db268 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:21.852129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 78/143] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:21.857902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:21.960134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0e2c-c2b3-4893-9168-59bb17830a79 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:21.990861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684525d8-a633-4c8f-bc2e-5b21eb01ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:21.992281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684525d8-a633-4c8f-bc2e-5b21eb01ae2e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:21.992626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684525d8-a633-4c8f-bc2e-5b21eb01ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:21.992948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684525d8-a633-4c8f-bc2e-5b21eb01ae2e None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:21.994156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684525d8-a633-4c8f-bc2e-5b21eb01ae2e None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:21.995654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684525d8-a633-4c8f-bc2e-5b21eb01ae2e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:21.997816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 66/144] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:21 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:22.003864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c2ada-643d-427b-b034-7542190db268 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.015478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086198f-9d59-4f54-bfe7-ea28e22a8e2b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.015761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086198f-9d59-4f54-bfe7-ea28e22a8e2b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.016042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086198f-9d59-4f54-bfe7-ea28e22a8e2b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.020983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 67/145] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:22.034280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dffc68-fc00-4b43-a9f5-671cb945028a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.034572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dffc68-fc00-4b43-a9f5-671cb945028a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.034836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dffc68-fc00-4b43-a9f5-671cb945028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.059802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c3dffc68-fc00-4b43-a9f5-671cb945028a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:22.061149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c3dffc68-fc00-4b43-a9f5-671cb945028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:22.138037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 68/146] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:22.139730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4174-1357-418d-ba87-cb6cff51444e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.140017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4174-1357-418d-ba87-cb6cff51444e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.140296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4174-1357-418d-ba87-cb6cff51444e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.145506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 69/147] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:22.148923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926818-e5cb-4561-bcd4-388a6c361c5f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.149213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926818-e5cb-4561-bcd4-388a6c361c5f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.149488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926818-e5cb-4561-bcd4-388a6c361c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.184674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4f926818-e5cb-4561-bcd4-388a6c361c5f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:22.185896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4f926818-e5cb-4561-bcd4-388a6c361c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:22.195198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c2ada-643d-427b-b034-7542190db268 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:22.229100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:22.230152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.230632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.231117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.232133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] RBAC: Adding query filter params (role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=c8a713a9aefa4037914c8eafea80ab1a) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:22.232655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:22.234298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:22.240834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 79/148] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/role_assignments?user.id=c8a713a9aefa4037914c8eafea80ab1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:22.241997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.265750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 70/149] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:22.327775 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f926818-e5cb-4561-bcd4-388a6c361c5f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.411257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161a30c-4978-4d43-9404-2927804cc57f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:22.465418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:22.466266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.466543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.466812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.478518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:22.487473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:22.488389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:22.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 80/150] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:22.494731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.583707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f926818-e5cb-4561-bcd4-388a6c361c5f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:22.621665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a27724-f94e-49da-9127-75c42c9818b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:22.622548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a27724-f94e-49da-9127-75c42c9818b8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.622826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a27724-f94e-49da-9127-75c42c9818b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.623200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a27724-f94e-49da-9127-75c42c9818b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.624763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc970a0-7dfb-4f4c-b745-bd99da1fdf06 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:22.634547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a27724-f94e-49da-9127-75c42c9818b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f8a27724-f94e-49da-9127-75c42c9818b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:22.642232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:22.644532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 71/151] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:22.646802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651ca3d-85fc-4391-86f2-442315822f5d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.647713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651ca3d-85fc-4391-86f2-442315822f5d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.647713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651ca3d-85fc-4391-86f2-442315822f5d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.647713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 72/152] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:22.651750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651ca3d-85fc-4391-86f2-442315822f5d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.666348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8cc1f-26aa-420b-8ca6-ad8d06bd76aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:22.667023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8cc1f-26aa-420b-8ca6-ad8d06bd76aa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.667304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8cc1f-26aa-420b-8ca6-ad8d06bd76aa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.667572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8cc1f-26aa-420b-8ca6-ad8d06bd76aa None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.668311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8cc1f-26aa-420b-8ca6-ad8d06bd76aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:22.668612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8cc1f-26aa-420b-8ca6-ad8d06bd76aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:22.670016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8cc1f-26aa-420b-8ca6-ad8d06bd76aa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:22.678416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 81/153] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:22.679524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141be9f-e4a8-4c1b-ad9f-6b097bde596d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.679806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141be9f-e4a8-4c1b-ad9f-6b097bde596d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.680074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141be9f-e4a8-4c1b-ad9f-6b097bde596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.697334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3141be9f-e4a8-4c1b-ad9f-6b097bde596d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:22.698624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3141be9f-e4a8-4c1b-ad9f-6b097bde596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:22.754842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651ca3d-85fc-4391-86f2-442315822f5d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:22.766244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 82/154] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:22.766922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141be9f-e4a8-4c1b-ad9f-6b097bde596d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.810879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc40c6-c3cd-47e4-8286-b2192f77f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:22.811560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc40c6-c3cd-47e4-8286-b2192f77f625 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.811845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc40c6-c3cd-47e4-8286-b2192f77f625 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.812123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc40c6-c3cd-47e4-8286-b2192f77f625 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.812870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc40c6-c3cd-47e4-8286-b2192f77f625 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:22.813184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc40c6-c3cd-47e4-8286-b2192f77f625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:22.814614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc40c6-c3cd-47e4-8286-b2192f77f625 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:22.825663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 73/155] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:22.826882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ca8b4-c212-473c-a1a7-82a4815f7998 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.827176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ca8b4-c212-473c-a1a7-82a4815f7998 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.827456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ca8b4-c212-473c-a1a7-82a4815f7998 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.828850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 74/156] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:22.829407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ca8b4-c212-473c-a1a7-82a4815f7998 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.881671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141be9f-e4a8-4c1b-ad9f-6b097bde596d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:22.915715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:22.916619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.916897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.917169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] PATH_INFO: `/v3/users/5b85f3c3beaa4b878ef617b7b044b497` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.918391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] RBAC: Authorizing `identity:get_user(user_id=5b85f3c3beaa4b878ef617b7b044b497)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:22.919830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:22.921447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 83/157] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/users/5b85f3c3beaa4b878ef617b7b044b497 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:22.921447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:22.939801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ca8b4-c212-473c-a1a7-82a4815f7998 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:22.974808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a661ea4-b2d1-4755-8025-125aff2ac52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:22.975615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a661ea4-b2d1-4755-8025-125aff2ac52f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.975903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a661ea4-b2d1-4755-8025-125aff2ac52f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.976182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a661ea4-b2d1-4755-8025-125aff2ac52f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.977385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a661ea4-b2d1-4755-8025-125aff2ac52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:22.978900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a661ea4-b2d1-4755-8025-125aff2ac52f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:22.980680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 75/158] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:22.981851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1b30-7f5e-4ddd-be2a-0726030cc5fb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:22.982139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1b30-7f5e-4ddd-be2a-0726030cc5fb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:22.982418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1b30-7f5e-4ddd-be2a-0726030cc5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:22.999123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a67a1b30-7f5e-4ddd-be2a-0726030cc5fb None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:23.000316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a67a1b30-7f5e-4ddd-be2a-0726030cc5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:23.029110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7f79-8593-4a63-bf0d-c7d1d98ed21b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:23.061106 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:23.062061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.062626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.063797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:23.065237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:23.072365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 84/159] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:22 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:23.072517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 76/160] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:23.072598 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.072953 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a1b30-7f5e-4ddd-be2a-0726030cc5fb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.174734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a1b30-7f5e-4ddd-be2a-0726030cc5fb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:23.175806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aebea1-c60e-4c74-98d0-6c41ade21646 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:23.206634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:23.207044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:23.207309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.207591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.207685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.207872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.207965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.208211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.208569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:23.210042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:23.236043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 77/161] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:52:23 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:23.236878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.311876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:23.314240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:23.354453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dd035-b1d4-4efe-9042-9f789069266c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:23.399250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:23.399992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.400266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.400543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.454484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 85/162] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:23.456915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.488992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:23.490510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:23.592681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3d42-2921-4e53-a876-c0684b54bf3f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:23.603911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 78/163] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:23.604777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.634360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df022a8f-2ae8-4c40-bde3-c5b1bdb96c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:23.635159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df022a8f-2ae8-4c40-bde3-c5b1bdb96c35 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.635438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df022a8f-2ae8-4c40-bde3-c5b1bdb96c35 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.635709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df022a8f-2ae8-4c40-bde3-c5b1bdb96c35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.647057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df022a8f-2ae8-4c40-bde3-c5b1bdb96c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-df022a8f-2ae8-4c40-bde3-c5b1bdb96c35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:23.655634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:23.656848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:23.657855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 86/164] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:23.659269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad27e9-a34e-4310-b8a9-36a85c55618a None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.659269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad27e9-a34e-4310-b8a9-36a85c55618a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.659269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad27e9-a34e-4310-b8a9-36a85c55618a None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.661181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 87/165] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:23.662533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad27e9-a34e-4310-b8a9-36a85c55618a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.734274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337719d-6edf-4d2b-9339-33715f0f4c8f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:23.772534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160f6f6-3b32-4948-88c4-0156ff3ed9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:23.773948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f6f6-3b32-4948-88c4-0156ff3ed9dd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.774221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f6f6-3b32-4948-88c4-0156ff3ed9dd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.774489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f6f6-3b32-4948-88c4-0156ff3ed9dd None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.775680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160f6f6-3b32-4948-88c4-0156ff3ed9dd None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:23.777250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160f6f6-3b32-4948-88c4-0156ff3ed9dd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:23.779303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 79/166] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:23 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:23.780554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d063a-b7ed-424b-8c72-3578a3d78968 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.780836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d063a-b7ed-424b-8c72-3578a3d78968 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.781106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d063a-b7ed-424b-8c72-3578a3d78968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.796422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad27e9-a34e-4310-b8a9-36a85c55618a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:23.799249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-938d063a-b7ed-424b-8c72-3578a3d78968 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:23.800437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-938d063a-b7ed-424b-8c72-3578a3d78968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:23.840156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:23.841019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:23.841295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:23.841648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:23.844663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:23.844778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:23.846736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 88/167] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:23 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:23.853105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.888487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 80/168] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:23.889681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d063a-b7ed-424b-8c72-3578a3d78968 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:23.973365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8430-3b6b-4fbd-87f1-9b3002e2c066 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.005743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d063a-b7ed-424b-8c72-3578a3d78968 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.007081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.008391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.008676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.008942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.009704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:24.010006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:24.011395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:24.020215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 89/169] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:24.021496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.047303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.047967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.048244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.048519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.049358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=5b85f3c3beaa4b878ef617b7b044b497) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:24.049694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:24.051127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:24.057331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 81/170] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:23 2022] GET /identity/v3/role_assignments?user.id=5b85f3c3beaa4b878ef617b7b044b497&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:24.058253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.160449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39a33-a494-4c14-9494-4a6a9cf492ba None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.201892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.202568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.202847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.203121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.203963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=c8a713a9aefa4037914c8eafea80ab1a) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:24.204270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:24.205795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:24.212876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 90/171] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:24 2022] GET /identity/v3/role_assignments?user.id=c8a713a9aefa4037914c8eafea80ab1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:24.218423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.221679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b885d-a8b0-42b4-a1d5-11c33a7bb763 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.275985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.276714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.276990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.277260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.299690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:24.316867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:24.319217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:24.322068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 82/172] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:24.330609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.432581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535648-9e68-46b7-baf2-80c648b9b86a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.489144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4aea-0b9c-4197-aab8-e00dc4fe071f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.538696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.540264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.540684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.541153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] PATH_INFO: `/v3/users/540846e3ec7f44bbb517e770cf1fc28b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.544359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=540846e3ec7f44bbb517e770cf1fc28b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:24.546896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:24.549729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 91/173] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:24 2022] GET /identity/v3/users/540846e3ec7f44bbb517e770cf1fc28b => generated 289 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:24.555983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.574368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.575105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.575382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.575650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.576467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:24.576767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:24.579567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:24.598683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 83/174] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:24.605619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.718323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99e15-5f9c-4bbd-8727-6e21b5d77327 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.756083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.756956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.757268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.757574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] PATH_INFO: `/v3/users/c8a713a9aefa4037914c8eafea80ab1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.758931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a713a9aefa4037914c8eafea80ab1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:24.760566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:24.762651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 84/175] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:24 2022] GET /identity/v3/users/c8a713a9aefa4037914c8eafea80ab1a => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:24.771124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.803384 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec1faf-8b07-486b-b36a-efcd4f9fb1a2 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.899070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.899947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.900230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.900504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:24.903141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3123-27e1-4bda-8fa0-e45f9f88d7c3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:24.906261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:24.907741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:24.909539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 92/176] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:24 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:24.915972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:24.942306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:24.942951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:24.943641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:24.943912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:25.015724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:25.017198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:25.116646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 85/177] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:52:25.122260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:25.133327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fff4c2-34e8-4ff0-812d-ff8f8a8a0694 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:25.196210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:25.197823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:25.198307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:25.198623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89/users/540846e3ec7f44bbb517e770cf1fc28b/roles/2dad68677730476daa6171ba3da694aa` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:25.206907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] RBAC: Authorizing `identity:create_grant(project_id=4bed9b3587c1435482592b924abd1a89, user_id=540846e3ec7f44bbb517e770cf1fc28b, role_id=2dad68677730476daa6171ba3da694aa)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:25.208389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:25.231898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 93/178] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:24 2022] PUT /identity/v3/projects/4bed9b3587c1435482592b924abd1a89/users/540846e3ec7f44bbb517e770cf1fc28b/roles/2dad68677730476daa6171ba3da694aa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:52:25.240486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc1b81-0974-4f30-9e65-d1fc79f5046f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:25.280700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc41a5-f379-4b68-8fa5-b0fc56eb0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:25.281646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc41a5-f379-4b68-8fa5-b0fc56eb0352 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:25.281928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc41a5-f379-4b68-8fa5-b0fc56eb0352 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:25.282195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc41a5-f379-4b68-8fa5-b0fc56eb0352 None admin] PATH_INFO: `/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:25.283511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc41a5-f379-4b68-8fa5-b0fc56eb0352 None admin] RBAC: Authorizing `identity:get_project(project_id=b5223adcafb24bbbb268d46ea08ceaa4)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:25.284975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc41a5-f379-4b68-8fa5-b0fc56eb0352 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:25.292790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 86/179] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:25 2022] GET /identity/v3/projects/b5223adcafb24bbbb268d46ea08ceaa4 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:25.294306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:25.428720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eebea-dec4-40f4-b840-3667f08d24fd None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:25.471694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b91181-624f-49a0-bedc-a50110173d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:25.472377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91181-624f-49a0-bedc-a50110173d54 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:25.472659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91181-624f-49a0-bedc-a50110173d54 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:25.472933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91181-624f-49a0-bedc-a50110173d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:25.473809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b91181-624f-49a0-bedc-a50110173d54 None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=b5223adcafb24bbbb268d46ea08ceaa4, user.id=c8a713a9aefa4037914c8eafea80ab1a) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:25.474122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b91181-624f-49a0-bedc-a50110173d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:25.475586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b91181-624f-49a0-bedc-a50110173d54 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:25.482508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 94/180] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:25 2022] GET /identity/v3/role_assignments?user.id=c8a713a9aefa4037914c8eafea80ab1a&scope.project.id=b5223adcafb24bbbb268d46ea08ceaa4&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:26.101619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6822-aa28-4687-a1ab-1f508f58c6ad None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.102131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6822-aa28-4687-a1ab-1f508f58c6ad None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.102220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6822-aa28-4687-a1ab-1f508f58c6ad None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.103908 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 87/181] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:26.108856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0559085-4ae5-4327-80e4-85f465728956 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.109145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0559085-4ae5-4327-80e4-85f465728956 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.109425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0559085-4ae5-4327-80e4-85f465728956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.130185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c0559085-4ae5-4327-80e4-85f465728956 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:26.131367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c0559085-4ae5-4327-80e4-85f465728956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:26.208079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 95/182] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:26.234960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6822-aa28-4687-a1ab-1f508f58c6ad None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:26.345009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6822-aa28-4687-a1ab-1f508f58c6ad None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:26.385046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df571d-d52b-4afe-aa60-5da6287c55ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:26.385891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df571d-d52b-4afe-aa60-5da6287c55ca None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.386165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df571d-d52b-4afe-aa60-5da6287c55ca None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.386431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df571d-d52b-4afe-aa60-5da6287c55ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.398366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df571d-d52b-4afe-aa60-5da6287c55ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-47df571d-d52b-4afe-aa60-5da6287c55ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:26.406017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:26.408069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:26.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 88/183] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:26.418311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0559085-4ae5-4327-80e4-85f465728956 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:26.521809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0559085-4ae5-4327-80e4-85f465728956 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:26.533650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dae9a-e5c4-4ce9-a95f-eed456349845 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.534264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dae9a-e5c4-4ce9-a95f-eed456349845 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.534744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dae9a-e5c4-4ce9-a95f-eed456349845 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.536328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 89/184] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:26.541919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6388f8-51fc-4756-a612-57bccec1868e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.542455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6388f8-51fc-4756-a612-57bccec1868e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.542929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6388f8-51fc-4756-a612-57bccec1868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.557808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:26.558481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.558756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.559026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.559761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:26.560063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:26.561424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:26.562885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3e6388f8-51fc-4756-a612-57bccec1868e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:26.564675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3e6388f8-51fc-4756-a612-57bccec1868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:26.570644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 96/185] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:26.576263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:26.645030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 90/186] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:26.645030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bde813-5bb4-4d75-bc9c-38c02f1f016a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.645030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bde813-5bb4-4d75-bc9c-38c02f1f016a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.645030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bde813-5bb4-4d75-bc9c-38c02f1f016a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.645030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 91/187] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:26.649847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c75d9-3340-47b6-8a4c-c880fc5fe812 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.650497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c75d9-3340-47b6-8a4c-c880fc5fe812 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.650497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c75d9-3340-47b6-8a4c-c880fc5fe812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.670831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e50c75d9-3340-47b6-8a4c-c880fc5fe812 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:26.672016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e50c75d9-3340-47b6-8a4c-c880fc5fe812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:26.685551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbcc24-719e-45cd-b996-97dbd44baf54 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:26.718326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:26.719479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.719911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.720377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] PATH_INFO: `/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.734028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] RBAC: Authorizing `identity:get_user(user_id=2fcf6977ea8445c6a17a0c49fd55cb29)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:26.734653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 92/188] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:26.735793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:26.737716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 97/189] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:26 2022] GET /identity/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:26.742360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c75d9-3340-47b6-8a4c-c880fc5fe812 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:26.750695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:26.845671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c75d9-3340-47b6-8a4c-c880fc5fe812 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:26.854509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6848c-5127-4fc9-8aaa-04222442ddae None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:26.879503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:26.880509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.880780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.881055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.890920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:26.891763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:26.892417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:26.892694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:26.892965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:26.899792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:26.900658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:26.901453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 93/190] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:26.902159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:26.971027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:26.974922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.008963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe0e9-5cee-4f70-ad44-d55b2b775cb9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.042152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.042940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.043240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.043483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.044660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.046152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.047992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 94/191] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:27.052869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:27.075292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 98/192] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:27.080684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:27.153169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef55e20-c669-4e10-9d10-b853f3a29871 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.175335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c2db-c492-4b4f-a6f7-bbc4d92affcd None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.187357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.188026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.188305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.188577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.189320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:27.189654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.191024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.199619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 95/193] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:27.200645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:27.208343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.209015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.209297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.209609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.210879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.212335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.232098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 99/194] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:52:27 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:27.242542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:27.318282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bceb4-3d32-4e7f-987b-621cabb647c6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.349599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b819d-5ec4-4f14-9a61-e3f089c015fc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.358236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.359123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.359404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.359681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.360969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.362523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.369774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 96/195] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:27 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:27.371433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:27.386624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.387574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.387853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.388122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] PATH_INFO: `/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.389498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] RBAC: Authorizing `identity:get_user(user_id=2fcf6977ea8445c6a17a0c49fd55cb29)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.391019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.397733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 100/196] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:27 2022] GET /identity/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:27.398785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:27.476509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0893e-2320-49ae-9b46-4760200d52dd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.515880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ba5bc-a6f0-4d34-8646-9b6ae3107ffe None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.518137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.518998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.519447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.519903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.521167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=2fcf6977ea8445c6a17a0c49fd55cb29) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:27.521677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.524248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.530914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 97/197] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:27 2022] GET /identity/v3/role_assignments?user.id=2fcf6977ea8445c6a17a0c49fd55cb29&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:27.565455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebed8b-de73-4d87-9821-327411ba6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.566572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebed8b-de73-4d87-9821-327411ba6baa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.567053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebed8b-de73-4d87-9821-327411ba6baa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.567524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebed8b-de73-4d87-9821-327411ba6baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.655150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebed8b-de73-4d87-9821-327411ba6baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.656639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebed8b-de73-4d87-9821-327411ba6baa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.765041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 101/198] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:27.770746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:27.805911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b4f0-b166-4413-96fb-3829e7f7328c None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.806219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b4f0-b166-4413-96fb-3829e7f7328c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.806464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b4f0-b166-4413-96fb-3829e7f7328c None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.807845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 102/199] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:27.812968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde652-b454-4d42-8268-a0a9d87cebda None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.813252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde652-b454-4d42-8268-a0a9d87cebda None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.813558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde652-b454-4d42-8268-a0a9d87cebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.834623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-47fde652-b454-4d42-8268-a0a9d87cebda None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:27.836013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-47fde652-b454-4d42-8268-a0a9d87cebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:27.921414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e64ac-857d-4997-bc63-5ebea4422638 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:27.965323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 103/200] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:27.979125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:27.980108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:27.980391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:27.980663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:27.985578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:27.987111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:27.989220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 98/201] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:27 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:27.995202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde652-b454-4d42-8268-a0a9d87cebda None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:28.002641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:28.126821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde652-b454-4d42-8268-a0a9d87cebda None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:28.154110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2e31d-988a-4034-8b1f-72cca05b937c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:28.163457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:28.164113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:28.164393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:28.164668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:28.165508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] RBAC: Adding query filter params (role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=2fcf6977ea8445c6a17a0c49fd55cb29) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:28.165824 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:28.167273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:28.176746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 104/202] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:27 2022] GET /identity/v3/role_assignments?user.id=2fcf6977ea8445c6a17a0c49fd55cb29&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:28.235815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:28.236620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:28.236901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:28.237172 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:28.258609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:28.266466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:28.267606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:28.269509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 99/203] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:28.273943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:28.386199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904f16a-31cd-43bd-8685-86962103a0c6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:28.421904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:28.422582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:28.422863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:28.423136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:28.423888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:28.424193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:28.425583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:28.435407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 105/204] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:28.440970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:28.550269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80873064-d092-4caa-8dce-4c2ca007e944 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:28.595067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:28.596251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:28.596706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:28.597171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] PATH_INFO: `/v3/users/540846e3ec7f44bbb517e770cf1fc28b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:28.598593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] RBAC: Authorizing `identity:get_user(user_id=540846e3ec7f44bbb517e770cf1fc28b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:28.600227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:28.602600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 100/205] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:28 2022] GET /identity/v3/users/540846e3ec7f44bbb517e770cf1fc28b => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:28.608182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:28.708716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843707d-dffb-4076-8810-eed560d9ea22 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:28.743055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:28.744051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:28.744510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:28.744958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:28.815284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:28.817039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:28.921576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 106/206] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:28.923574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:29.046940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe775038-b66d-48e1-924a-3e1e9b5ea547 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:29.094023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa9d0f-8566-4463-a16b-90ac7ffebcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:29.095225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa9d0f-8566-4463-a16b-90ac7ffebcd1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:29.095991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa9d0f-8566-4463-a16b-90ac7ffebcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:29.096445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa9d0f-8566-4463-a16b-90ac7ffebcd1 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:29.097892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa9d0f-8566-4463-a16b-90ac7ffebcd1 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:29.099506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa9d0f-8566-4463-a16b-90ac7ffebcd1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:29.101811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 101/207] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:28 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:29.107112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:29.233242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c196429-2fb2-4587-9c54-dfdf69c71de7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:29.271249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e877be9-3bc5-482d-9cb3-b7be5b718e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:29.271902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e877be9-3bc5-482d-9cb3-b7be5b718e4c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:29.272183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e877be9-3bc5-482d-9cb3-b7be5b718e4c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:29.272450 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e877be9-3bc5-482d-9cb3-b7be5b718e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:29.273313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e877be9-3bc5-482d-9cb3-b7be5b718e4c None admin] RBAC: Adding query filter params (role.id=2dad68677730476daa6171ba3da694aa, scope.project.id=4bed9b3587c1435482592b924abd1a89, user.id=540846e3ec7f44bbb517e770cf1fc28b) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:29.273654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e877be9-3bc5-482d-9cb3-b7be5b718e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:29.275074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e877be9-3bc5-482d-9cb3-b7be5b718e4c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:29.280851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 107/208] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:29 2022] GET /identity/v3/role_assignments?user.id=540846e3ec7f44bbb517e770cf1fc28b&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=2dad68677730476daa6171ba3da694aa => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:30.060277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c95ca-730e-4bfb-8d7b-4cd1a75d0dc2 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.061286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c95ca-730e-4bfb-8d7b-4cd1a75d0dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.061804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c95ca-730e-4bfb-8d7b-4cd1a75d0dc2 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.063903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 102/209] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:30.070515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a6d3-c64b-4d36-aee1-a73460edf2d0 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.071143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a6d3-c64b-4d36-aee1-a73460edf2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.071649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a6d3-c64b-4d36-aee1-a73460edf2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.089928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7f24a6d3-c64b-4d36-aee1-a73460edf2d0 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:30.091504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7f24a6d3-c64b-4d36-aee1-a73460edf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:30.161824 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 108/210] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:30.185151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c95ca-730e-4bfb-8d7b-4cd1a75d0dc2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.198582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebb007-844d-4634-9bc6-e47b3dda45e0 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.199084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebb007-844d-4634-9bc6-e47b3dda45e0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.199527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebb007-844d-4634-9bc6-e47b3dda45e0 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.201327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 109/211] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:30.206711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858154cc-6c6f-427a-9f6c-e88cf25921f5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.207259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858154cc-6c6f-427a-9f6c-e88cf25921f5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.207754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858154cc-6c6f-427a-9f6c-e88cf25921f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.225698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-858154cc-6c6f-427a-9f6c-e88cf25921f5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:30.227383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-858154cc-6c6f-427a-9f6c-e88cf25921f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:30.289000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c95ca-730e-4bfb-8d7b-4cd1a75d0dc2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.301492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 110/212] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:30.301492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c623cb-7cde-4c24-a71b-6696454a19be None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.301492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c623cb-7cde-4c24-a71b-6696454a19be None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.301492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c623cb-7cde-4c24-a71b-6696454a19be None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.301492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 111/213] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:30.303533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500f3e-81c2-44a3-b34b-cb1f7b94669f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.304324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500f3e-81c2-44a3-b34b-cb1f7b94669f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.304706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500f3e-81c2-44a3-b34b-cb1f7b94669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.324207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-16500f3e-81c2-44a3-b34b-cb1f7b94669f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:30.325380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-16500f3e-81c2-44a3-b34b-cb1f7b94669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:30.337653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.338447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.338723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.338992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.349045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:30.356632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:30.357768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 103/214] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:30.358745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.404397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 112/215] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:30.405240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500f3e-81c2-44a3-b34b-cb1f7b94669f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.468331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15237f-55ed-49ee-b78c-d0a2ba51a047 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.500793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.501554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.501836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.502108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.504413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500f3e-81c2-44a3-b34b-cb1f7b94669f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.512589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:30.520141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:30.521296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:30.522128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 104/216] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:30.522811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.543541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.544205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.544488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.544760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.545521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:30.545827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:30.547210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:30.555699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 113/217] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:30.556344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.623321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62d162-701a-4076-87c8-4eb926dd5a7d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.652221 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8b263-577d-49be-9b9a-1c3fe5f06e75 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.655823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.656618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.656898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.657178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.658383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:30.659825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:30.661530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 105/218] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:30.663971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.690758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.691425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.691707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.691980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.692722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:30.693034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:30.694459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:30.702409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 114/219] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:30.702409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.771657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05d6d-bab8-4445-a16a-779a859dc740 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.798747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544468ed-96b6-449a-afd9-a881dc9ab2b9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.805689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.806573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.806842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.807113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] PATH_INFO: `/v3/users/bb5ba2632de642abb41db7234fbc20fd` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.823022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb5ba2632de642abb41db7234fbc20fd)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:30.824537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:30.826391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 106/220] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/users/bb5ba2632de642abb41db7234fbc20fd => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:30.827224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.836078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.837403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.837713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.837989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.839098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:30.840213 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:30.862098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 115/221] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:52:30 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:30.871269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:30.940376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626e56-91fa-4104-8252-7fab06828cf3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:30.984203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:30.985647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:30.985932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:30.986200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] PATH_INFO: `/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:30.987791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] RBAC: Authorizing `identity:get_user(user_id=2fcf6977ea8445c6a17a0c49fd55cb29)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:30.989446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:30.993039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 107/222] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:30.998308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:31.004186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1abeef-bdaa-439a-9815-03cc70392fda None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:31.041500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3811876-8515-407c-8c62-91e540941646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:31.042077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3811876-8515-407c-8c62-91e540941646 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.042356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3811876-8515-407c-8c62-91e540941646 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.042620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3811876-8515-407c-8c62-91e540941646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.109558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e6fc-3c15-47b2-9bf0-29c8d8202334 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:31.116529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3811876-8515-407c-8c62-91e540941646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:31.118035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3811876-8515-407c-8c62-91e540941646 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:31.146117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166884-1f32-4cb7-9183-d79c3b04230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:31.146987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166884-1f32-4cb7-9183-d79c3b04230d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.147264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166884-1f32-4cb7-9183-d79c3b04230d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.148048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166884-1f32-4cb7-9183-d79c3b04230d None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.149957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a166884-1f32-4cb7-9183-d79c3b04230d None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:31.151419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a166884-1f32-4cb7-9183-d79c3b04230d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:31.153241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 108/223] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:31.154999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4cbf-baaa-4d85-85b8-7b7fe2228a23 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.155286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4cbf-baaa-4d85-85b8-7b7fe2228a23 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.155563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4cbf-baaa-4d85-85b8-7b7fe2228a23 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.159431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 109/224] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:31.162391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4cbf-baaa-4d85-85b8-7b7fe2228a23 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:31.241911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 116/225] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:31.243206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768c51-cf23-4316-a9ba-884bb56eb571 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.243488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768c51-cf23-4316-a9ba-884bb56eb571 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.243757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768c51-cf23-4316-a9ba-884bb56eb571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.263227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-30768c51-cf23-4316-a9ba-884bb56eb571 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:31.265642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-30768c51-cf23-4316-a9ba-884bb56eb571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:31.280650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4cbf-baaa-4d85-85b8-7b7fe2228a23 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:31.329053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:31.329976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.330250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.330520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/2fcf6977ea8445c6a17a0c49fd55cb29/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.332003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 117/226] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:31.332444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] RBAC: Authorizing `identity:create_grant(project_id=b86ce6c4c1e94d8284541207da7bf7cf, user_id=2fcf6977ea8445c6a17a0c49fd55cb29, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:31.333559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768c51-cf23-4316-a9ba-884bb56eb571 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:31.333920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:31.352721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 110/227] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:31 2022] PUT /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/2fcf6977ea8445c6a17a0c49fd55cb29/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:31.374977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:31.498830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39f6e-0824-498e-abb7-2413affb503f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:31.539220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:31.540056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.540329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.540592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.545378 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768c51-cf23-4316-a9ba-884bb56eb571 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:31.552888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:31.562987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:31.563906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:31.564697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 111/228] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:31.571012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:31.614925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:31.616162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.616669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.617147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.618548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:31.620187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:31.622146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 118/229] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:31 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:31.628081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:31.687277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c17d8-7431-4c23-b7f7-18cf5a7077dc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:31.770179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:31.771488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.771963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.772424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.773934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:31.774452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:31.776097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:31.777434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7476a0-48d4-4a34-9e9a-bf278df49d2d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:31.791831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 112/230] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:31.798824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:31.816631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:31.817339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:31.817657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:31.817926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:31.818808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=bb5ba2632de642abb41db7234fbc20fd) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:31.819118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:31.821190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:31.827215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 119/231] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:31 2022] GET /identity/v3/role_assignments?user.id=bb5ba2632de642abb41db7234fbc20fd&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:31.989955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16891635-0642-4eb7-9c80-46fd7bed6889 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:32.042238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:32.043428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:32.043872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:32.044292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] PATH_INFO: `/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:32.045817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] RBAC: Authorizing `identity:get_user(user_id=2fcf6977ea8445c6a17a0c49fd55cb29)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:32.047451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:32.049758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 113/232] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:31 2022] GET /identity/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:32.055691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:32.211770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ee711-3aa4-4c51-b904-5a248e8f0f68 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:32.262275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735961df-fe83-4364-aa58-5637a846d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:32.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735961df-fe83-4364-aa58-5637a846d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:32.263398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735961df-fe83-4364-aa58-5637a846d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:32.263672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735961df-fe83-4364-aa58-5637a846d9a1 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:32.264902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735961df-fe83-4364-aa58-5637a846d9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:32.266374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735961df-fe83-4364-aa58-5637a846d9a1 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:32.268065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 120/233] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:32 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:32.274093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:32.421384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41551d-539b-4087-8c02-18ec18bc19ba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:32.467446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d768bd-75a8-42d3-a788-964197bfec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:32.468336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d768bd-75a8-42d3-a788-964197bfec76 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:32.468611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d768bd-75a8-42d3-a788-964197bfec76 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:32.468881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d768bd-75a8-42d3-a788-964197bfec76 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/2fcf6977ea8445c6a17a0c49fd55cb29/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:32.475214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d768bd-75a8-42d3-a788-964197bfec76 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86ce6c4c1e94d8284541207da7bf7cf, user_id=2fcf6977ea8445c6a17a0c49fd55cb29, role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:32.476678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d768bd-75a8-42d3-a788-964197bfec76 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:32.500477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 114/234] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:32 2022] PUT /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/2fcf6977ea8445c6a17a0c49fd55cb29/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:33.692190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b78e-b0cd-41de-bb0d-97f71fd5d2fa None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:33.693222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b78e-b0cd-41de-bb0d-97f71fd5d2fa None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:33.693745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b78e-b0cd-41de-bb0d-97f71fd5d2fa None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:33.696189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 121/235] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:33.700391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36bed4-f01f-42e8-b606-a1e57e21728a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:33.701231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36bed4-f01f-42e8-b606-a1e57e21728a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:33.701744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36bed4-f01f-42e8-b606-a1e57e21728a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:33.703598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 115/236] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:33.706972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4515b-d2f8-47a7-bc76-e3bebfda105b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:33.707473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4515b-d2f8-47a7-bc76-e3bebfda105b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:33.707970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4515b-d2f8-47a7-bc76-e3bebfda105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:33.708144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d83d3-449d-4cb0-89f7-b2cc5fc8f194 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:33.708423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d83d3-449d-4cb0-89f7-b2cc5fc8f194 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:33.708698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d83d3-449d-4cb0-89f7-b2cc5fc8f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:33.726631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-409d83d3-449d-4cb0-89f7-b2cc5fc8f194 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:33.727843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-409d83d3-449d-4cb0-89f7-b2cc5fc8f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:33.743611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7bb4515b-d2f8-47a7-bc76-e3bebfda105b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:33.745579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7bb4515b-d2f8-47a7-bc76-e3bebfda105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:33.827707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 116/237] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:33.854830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 122/238] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:33.872533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d83d3-449d-4cb0-89f7-b2cc5fc8f194 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:33.890760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4515b-d2f8-47a7-bc76-e3bebfda105b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:33.994357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d83d3-449d-4cb0-89f7-b2cc5fc8f194 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.030202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13890f05-f439-479d-ad32-ba9713e3686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.031357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890f05-f439-479d-ad32-ba9713e3686b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.031854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890f05-f439-479d-ad32-ba9713e3686b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.032340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890f05-f439-479d-ad32-ba9713e3686b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.033735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13890f05-f439-479d-ad32-ba9713e3686b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:34.034251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4515b-d2f8-47a7-bc76-e3bebfda105b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.036055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13890f05-f439-479d-ad32-ba9713e3686b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:34.037970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 117/239] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:34.044855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914c25-3068-4f9c-b60f-75ebced9a995 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.045696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914c25-3068-4f9c-b60f-75ebced9a995 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.046179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914c25-3068-4f9c-b60f-75ebced9a995 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.047986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 118/240] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:34.048957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914c25-3068-4f9c-b60f-75ebced9a995 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:34.068972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33ecd0-76b6-47a8-803e-dc1b99034443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.070371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ecd0-76b6-47a8-803e-dc1b99034443 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.070652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ecd0-76b6-47a8-803e-dc1b99034443 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.070925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ecd0-76b6-47a8-803e-dc1b99034443 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.083269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33ecd0-76b6-47a8-803e-dc1b99034443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-df33ecd0-76b6-47a8-803e-dc1b99034443 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:34.091613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:34.092679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:34.094027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 123/241] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:34.099482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838fcc-2a46-4f3c-843f-a70fb88b6a1b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.099822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838fcc-2a46-4f3c-843f-a70fb88b6a1b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.100045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838fcc-2a46-4f3c-843f-a70fb88b6a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.117160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f4838fcc-2a46-4f3c-843f-a70fb88b6a1b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:34.118357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f4838fcc-2a46-4f3c-843f-a70fb88b6a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:34.162584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914c25-3068-4f9c-b60f-75ebced9a995 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.184619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 124/242] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:34.185245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838fcc-2a46-4f3c-843f-a70fb88b6a1b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:34.199444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.200459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.200979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.201552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.203863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:34.205650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:34.227852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 119/243] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:52:34 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:34.229342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:34.324073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838fcc-2a46-4f3c-843f-a70fb88b6a1b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.371915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.372603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.373736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.374591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.375354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:34.375666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:34.377105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:34.397917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 125/244] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:34.406752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:34.456482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55cb71-7155-46fb-b222-54ae83332583 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.515641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.516534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.516887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.517227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.531478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:34.541820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:34.542767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:34.543736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 120/245] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:34.549075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b467-9a5c-4a1a-8641-e2c14e05044b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.549624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:34.591057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.592194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.592624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.593072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] PATH_INFO: `/v3/users/6dacca519b8745ca9a52a4f49fab774d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.608680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] RBAC: Authorizing `identity:get_user(user_id=6dacca519b8745ca9a52a4f49fab774d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:34.610397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:34.612248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 126/246] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:34 2022] GET /identity/v3/users/6dacca519b8745ca9a52a4f49fab774d => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:34.618322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:34.673081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a516aac-c39e-4d24-a310-3d712ac4d663 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.709259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.710780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.711260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.711724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.712695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:34.713203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:34.714821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:34.726135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 121/247] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:34.731420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:34.746693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2916-e8d4-4082-92ab-9a19408c51d6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.790551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb8d7-4d77-4592-962f-1572c2fe8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.791804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb8d7-4d77-4592-962f-1572c2fe8e0c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.792440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb8d7-4d77-4592-962f-1572c2fe8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.792919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb8d7-4d77-4592-962f-1572c2fe8e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.855743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14fa83-81c3-4839-b8d2-fd047a9c6e33 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:34.885308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb8d7-4d77-4592-962f-1572c2fe8e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:34.888435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb8d7-4d77-4592-962f-1572c2fe8e0c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:34.899744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263c31f-79ad-44d2-b2cc-a11d0aafe3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:34.900695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263c31f-79ad-44d2-b2cc-a11d0aafe3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.900974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263c31f-79ad-44d2-b2cc-a11d0aafe3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.901241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263c31f-79ad-44d2-b2cc-a11d0aafe3a4 None admin] PATH_INFO: `/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.902465 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263c31f-79ad-44d2-b2cc-a11d0aafe3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=2fcf6977ea8445c6a17a0c49fd55cb29)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:34.903910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263c31f-79ad-44d2-b2cc-a11d0aafe3a4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:34.905879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 122/248] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:34 2022] GET /identity/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:34.907152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913fd00-3ee5-4807-b205-aa5f6ddeef29 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:34.907429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913fd00-3ee5-4807-b205-aa5f6ddeef29 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:34.907700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913fd00-3ee5-4807-b205-aa5f6ddeef29 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:34.913663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 123/249] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:34.915724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913fd00-3ee5-4807-b205-aa5f6ddeef29 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.030564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 127/250] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:52:35.032145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238dfff-c927-4ac0-bc72-292e80b63e09 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.032562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238dfff-c927-4ac0-bc72-292e80b63e09 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.032962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238dfff-c927-4ac0-bc72-292e80b63e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.039360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913fd00-3ee5-4807-b205-aa5f6ddeef29 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:35.054285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3238dfff-c927-4ac0-bc72-292e80b63e09 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:35.056220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3238dfff-c927-4ac0-bc72-292e80b63e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:35.089495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:35.089495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.089495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.089495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.170672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 128/251] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:35.171783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238dfff-c927-4ac0-bc72-292e80b63e09 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.198961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:35.202332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:35.309955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 124/252] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:35.311016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.343547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238dfff-c927-4ac0-bc72-292e80b63e09 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:35.384566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dca54-655f-4654-97ca-aafb5a1e9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:35.385639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dca54-655f-4654-97ca-aafb5a1e9c15 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.385923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dca54-655f-4654-97ca-aafb5a1e9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.386199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dca54-655f-4654-97ca-aafb5a1e9c15 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.387977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dca54-655f-4654-97ca-aafb5a1e9c15 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:35.390357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dca54-655f-4654-97ca-aafb5a1e9c15 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:35.392358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 129/253] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:35.393579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151772-25d7-413f-ac07-47413b755226 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.393862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151772-25d7-413f-ac07-47413b755226 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.394136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151772-25d7-413f-ac07-47413b755226 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.395605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 130/254] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:35.400829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54151772-25d7-413f-ac07-47413b755226 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.435170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0edee-cdf3-438a-b287-e8a53f6af616 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:35.470943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:35.471940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.472321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.472690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.483780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:35.491904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:35.492797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:35.493606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:35.497650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 125/255] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:35.498518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.501714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54151772-25d7-413f-ac07-47413b755226 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:35.536204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ae895-e76b-4f1f-adf0-c444de000b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:35.537070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ae895-e76b-4f1f-adf0-c444de000b68 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.537349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ae895-e76b-4f1f-adf0-c444de000b68 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.537634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ae895-e76b-4f1f-adf0-c444de000b68 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.538848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ae895-e76b-4f1f-adf0-c444de000b68 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:35.540294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ae895-e76b-4f1f-adf0-c444de000b68 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:35.542033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 131/256] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:35.543254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f925b-02cd-4c1d-b25f-98b5b7201119 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.543537 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f925b-02cd-4c1d-b25f-98b5b7201119 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.543808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f925b-02cd-4c1d-b25f-98b5b7201119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.560635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9c9f925b-02cd-4c1d-b25f-98b5b7201119 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:35.561781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9c9f925b-02cd-4c1d-b25f-98b5b7201119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:35.604516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a339f-02e9-4fd5-8b4d-46136c274f50 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:35.627865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 132/257] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:35.628734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f925b-02cd-4c1d-b25f-98b5b7201119 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.641160 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:35.641936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.642197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.642521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.643426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] RBAC: Adding query filter params (role.id=2dad68677730476daa6171ba3da694aa, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=6dacca519b8745ca9a52a4f49fab774d) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:35.643736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:35.645724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:35.653104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 126/258] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/role_assignments?user.id=6dacca519b8745ca9a52a4f49fab774d&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=2dad68677730476daa6171ba3da694aa => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:35.658538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.768713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f925b-02cd-4c1d-b25f-98b5b7201119 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:35.839985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:35.840585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.840864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.841134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.841902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:35.842207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:35.843595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:35.868359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 133/259] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:35.869504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:35.898863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13dcae-9aa0-40e1-8cb4-3098d6b23602 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:35.976279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:35.981510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:35.981510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:35.981510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:35.981510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=2fcf6977ea8445c6a17a0c49fd55cb29) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:35.981510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:35.981510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:35.987542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 127/260] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/role_assignments?user.id=2fcf6977ea8445c6a17a0c49fd55cb29&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:35.988389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:36.025727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5522151-b791-4aae-a58f-62820440b9b7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:36.089496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:36.089496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:36.089496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:36.089496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:36.104054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c689d0-460f-49bc-be71-c9e66b044941 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:36.106383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:36.129486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:36.130425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:36.131237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 134/261] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:36.141487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:36.143244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:36.144135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:36.144410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:36.144678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] PATH_INFO: `/v3/users/bb5ba2632de642abb41db7234fbc20fd` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:36.146173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] RBAC: Authorizing `identity:get_user(user_id=bb5ba2632de642abb41db7234fbc20fd)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:36.147678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:36.149333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 128/262] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:35 2022] GET /identity/v3/users/bb5ba2632de642abb41db7234fbc20fd => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:36.160040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:36.372532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67630b-52f3-4dbb-a67f-c949ae86a905 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:36.402711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdff48-6f50-4e9f-9b76-96622e676ea3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:36.449433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380e805-6fce-4758-8669-75a92627938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:36.450343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380e805-6fce-4758-8669-75a92627938d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:36.450621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380e805-6fce-4758-8669-75a92627938d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:36.450891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380e805-6fce-4758-8669-75a92627938d None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:36.452081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380e805-6fce-4758-8669-75a92627938d None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:36.453547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380e805-6fce-4758-8669-75a92627938d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:36.455261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 129/263] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:36 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:36.468220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380e805-6fce-4758-8669-75a92627938d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:36.470190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:36.470878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:36.471161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:36.471435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:36.472187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:36.472494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:36.477549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:36.497393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 135/264] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:36.504938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:36.690074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefa461-b1fa-413f-855a-3b8635bde611 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:36.713113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380e805-6fce-4758-8669-75a92627938d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:36.732858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:36.733777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:36.734059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:36.734334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] PATH_INFO: `/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:36.738186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] RBAC: Authorizing `identity:get_user(user_id=2fcf6977ea8445c6a17a0c49fd55cb29)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:36.739810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:36.742046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 136/265] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:36 2022] GET /identity/v3/users/2fcf6977ea8445c6a17a0c49fd55cb29 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:36.753621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:36.764268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:36.765166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:36.765443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:36.765738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/bb5ba2632de642abb41db7234fbc20fd/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:36.767815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] RBAC: Authorizing `identity:create_grant(project_id=b86ce6c4c1e94d8284541207da7bf7cf, user_id=bb5ba2632de642abb41db7234fbc20fd, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:36.769260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:36.787833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 130/266] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:36 2022] PUT /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/bb5ba2632de642abb41db7234fbc20fd/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:36.872664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83d00b-169e-4f4a-9930-29dee249783f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:36.907290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:36.907956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:36.908237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:36.908510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:36.980152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:36.981654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:37.087363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 137/267] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:37.092921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:37.197276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e985-c728-4b96-8250-ff6f9b61869c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:37.232525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e828a-bdc8-4fd4-a59a-806b02ea8b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:37.233306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e828a-bdc8-4fd4-a59a-806b02ea8b23 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.233613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e828a-bdc8-4fd4-a59a-806b02ea8b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.233881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e828a-bdc8-4fd4-a59a-806b02ea8b23 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.235097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e828a-bdc8-4fd4-a59a-806b02ea8b23 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:37.236559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e828a-bdc8-4fd4-a59a-806b02ea8b23 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:37.238618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 131/268] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:37 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:37.244527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:37.354989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e4634-fcb5-435d-9243-ca376e765653 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.355612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e4634-fcb5-435d-9243-ca376e765653 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.356079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e4634-fcb5-435d-9243-ca376e765653 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.357720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 132/269] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:37.362820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8b82-0fea-4c3d-8957-8a7c9a5e7a77 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.363347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8b82-0fea-4c3d-8957-8a7c9a5e7a77 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.363832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8b82-0fea-4c3d-8957-8a7c9a5e7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.375108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c44f1-a341-47c9-ba19-ebe5f888ba0a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:37.392039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d3ed8b82-0fea-4c3d-8957-8a7c9a5e7a77 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:37.393564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d3ed8b82-0fea-4c3d-8957-8a7c9a5e7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:37.447118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:37.448148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.448631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.449102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.450162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] RBAC: Adding query filter params (role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=2fcf6977ea8445c6a17a0c49fd55cb29) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:37.450673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:37.452291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:37.459156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 138/270] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:37 2022] GET /identity/v3/role_assignments?user.id=2fcf6977ea8445c6a17a0c49fd55cb29&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:37.527012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 133/271] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:37.562670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:37.702951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6cf14-d0cd-4d97-8a66-9edf089fc716 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:37.717736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9de45-5d86-4cf3-8d7f-f1347b7a2892 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.718498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9de45-5d86-4cf3-8d7f-f1347b7a2892 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.718973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9de45-5d86-4cf3-8d7f-f1347b7a2892 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.720561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 134/272] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:37.727444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ffe13-2f19-4309-8fa2-320c764eb9eb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.727983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ffe13-2f19-4309-8fa2-320c764eb9eb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.728452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ffe13-2f19-4309-8fa2-320c764eb9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.745269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:37.746092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.746369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.746639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.751037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f78ffe13-2f19-4309-8fa2-320c764eb9eb None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:37.753527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f78ffe13-2f19-4309-8fa2-320c764eb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:37.760960 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:37.769050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:37.769956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:37.771008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:37.774234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 139/273] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:37.782414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:37.827999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 135/274] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:37.853399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ffe13-2f19-4309-8fa2-320c764eb9eb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:37.887456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690f41-5754-4541-8aab-7418c5abe182 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:37.921184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:37.921889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.922167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.922440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.923172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:37.923663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:37.925330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:37.934723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 140/275] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:37.940151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:37.958469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ffe13-2f19-4309-8fa2-320c764eb9eb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:37.994250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:37.995380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:37.995859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:37.996327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:37.997714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:37.999371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:38.001208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 136/276] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:38.007945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:38.042016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f101b58-1995-46b3-9991-22cf091a1383 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:38.076329 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:38.077577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:38.077997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:38.078451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] PATH_INFO: `/v3/users/8f157f851411407ca90b780d00550e30` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:38.093024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] RBAC: Authorizing `identity:get_user(user_id=8f157f851411407ca90b780d00550e30)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:38.094843 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:38.096747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 141/277] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:37 2022] GET /identity/v3/users/8f157f851411407ca90b780d00550e30 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:38.102466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:38.108851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0f614-ba4e-4824-a407-4c8383b77f0f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:38.143781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd55bc-9153-4aae-bbe6-e6076d37b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:38.144717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd55bc-9153-4aae-bbe6-e6076d37b60f None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:38.145138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd55bc-9153-4aae-bbe6-e6076d37b60f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:38.145886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd55bc-9153-4aae-bbe6-e6076d37b60f None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:38.146787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd55bc-9153-4aae-bbe6-e6076d37b60f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:38.148463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd55bc-9153-4aae-bbe6-e6076d37b60f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:38.174287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 137/278] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:52:38 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:38.216661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93592f-54cf-40e7-8726-3dd3a1bf4749 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:38.255103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68e506-7224-4617-b5ea-374712d19303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:38.255799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68e506-7224-4617-b5ea-374712d19303 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:38.256090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68e506-7224-4617-b5ea-374712d19303 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:38.256360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68e506-7224-4617-b5ea-374712d19303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:38.257238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68e506-7224-4617-b5ea-374712d19303 None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, user.id=8f157f851411407ca90b780d00550e30, scope.system=all) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:38.257588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68e506-7224-4617-b5ea-374712d19303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:38.259186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68e506-7224-4617-b5ea-374712d19303 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:38.265042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 142/279] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 18:52:38 2022] GET /identity/v3/role_assignments?user.id=8f157f851411407ca90b780d00550e30&scope.system=all&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:38.675232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029c37-2dc0-4dd0-a534-cd98140f6b58 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:38.675579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029c37-2dc0-4dd0-a534-cd98140f6b58 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:38.675780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029c37-2dc0-4dd0-a534-cd98140f6b58 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:38.677422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 138/280] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:38.682694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da130-5f90-4d23-8e7a-9d65787fb05b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:38.682979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da130-5f90-4d23-8e7a-9d65787fb05b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:38.683254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da130-5f90-4d23-8e7a-9d65787fb05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:38.703314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2d2da130-5f90-4d23-8e7a-9d65787fb05b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:38.704516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2d2da130-5f90-4d23-8e7a-9d65787fb05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:38.786228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 143/281] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:38.830910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029c37-2dc0-4dd0-a534-cd98140f6b58 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:38.939085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029c37-2dc0-4dd0-a534-cd98140f6b58 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:38.976349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:38.977515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:38.977999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:38.978599 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:38.989155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:38.997137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:38.998158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:38.999141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:39.001453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 139/282] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:39.007877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2da130-5f90-4d23-8e7a-9d65787fb05b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:39.144406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2da130-5f90-4d23-8e7a-9d65787fb05b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:39.187100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:39.187783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:39.188062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:39.188336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:39.189081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:39.189442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:39.190795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:39.204770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 144/283] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:39.211080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:39.365293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67d9a-10c3-43f0-b680-580a40b5c93b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:39.404251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5724318-2626-4a76-a7df-ef4b8a5e5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:39.405496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724318-2626-4a76-a7df-ef4b8a5e5063 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:39.406006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724318-2626-4a76-a7df-ef4b8a5e5063 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:39.406477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724318-2626-4a76-a7df-ef4b8a5e5063 None admin] PATH_INFO: `/v3/users/6dacca519b8745ca9a52a4f49fab774d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:39.407873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724318-2626-4a76-a7df-ef4b8a5e5063 None admin] RBAC: Authorizing `identity:get_user(user_id=6dacca519b8745ca9a52a4f49fab774d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:39.409558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724318-2626-4a76-a7df-ef4b8a5e5063 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:39.411787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 140/284] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:39 2022] GET /identity/v3/users/6dacca519b8745ca9a52a4f49fab774d => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:39.417257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:39.582315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea12e7-046f-4da3-a919-8ae56d83c3ab None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:39.633813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:39.635314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:39.635825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:39.636318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:39.638258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:39.639713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:39.642533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 145/285] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:39 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:39.644520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9fe2c-9e3b-4202-ad0b-907cecdbf405 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:39.644809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9fe2c-9e3b-4202-ad0b-907cecdbf405 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:39.645086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9fe2c-9e3b-4202-ad0b-907cecdbf405 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:39.648258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 141/286] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:39.649206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:39.653356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab45f5-9081-4f83-ba33-3b9e19e9305f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:39.653691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab45f5-9081-4f83-ba33-3b9e19e9305f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:39.653970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab45f5-9081-4f83-ba33-3b9e19e9305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:39.683214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-04ab45f5-9081-4f83-ba33-3b9e19e9305f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:39.684409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-04ab45f5-9081-4f83-ba33-3b9e19e9305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:39.748564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0669b-7b86-4a88-b401-42377142b0d0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:39.781606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:39.782503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:39.782776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:39.783041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/6dacca519b8745ca9a52a4f49fab774d/roles/2dad68677730476daa6171ba3da694aa` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:39.785028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86ce6c4c1e94d8284541207da7bf7cf, user_id=6dacca519b8745ca9a52a4f49fab774d, role_id=2dad68677730476daa6171ba3da694aa)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:39.786500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:39.803529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 146/287] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:52:39 2022] PUT /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/users/6dacca519b8745ca9a52a4f49fab774d/roles/2dad68677730476daa6171ba3da694aa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:52:39.859432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 142/288] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:39.895582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:40.031583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f220af-37cc-47de-82ee-2ae16b068c84 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:40.069103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:40.070004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:40.070294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:40.070566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:40.081167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:40.089651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:40.090624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:40.091691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 147/289] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:40.096738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab45f5-9081-4f83-ba33-3b9e19e9305f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:40.222890 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab45f5-9081-4f83-ba33-3b9e19e9305f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:40.260544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:40.261220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:40.261569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:40.261839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:40.262578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:40.262879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:40.264256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:40.273547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 143/290] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:40.280315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:40.426754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c8d5-3ee0-41cd-9fbf-cd23095f6619 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:40.470030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:40.471280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:40.471802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:40.472279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] PATH_INFO: `/v3/users/bb5ba2632de642abb41db7234fbc20fd` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:40.478375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=bb5ba2632de642abb41db7234fbc20fd)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:40.479795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:40.481726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 148/291] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:40 2022] GET /identity/v3/users/bb5ba2632de642abb41db7234fbc20fd => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:40.487018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:40.653885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874fb80-6e5e-4b40-b177-65692ad47edd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:40.699485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06006635-8675-40cf-b4d5-b039d2d6c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:40.700137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006635-8675-40cf-b4d5-b039d2d6c594 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:40.700422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006635-8675-40cf-b4d5-b039d2d6c594 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:40.700696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006635-8675-40cf-b4d5-b039d2d6c594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:40.784846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06006635-8675-40cf-b4d5-b039d2d6c594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:40.786253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06006635-8675-40cf-b4d5-b039d2d6c594 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:40.913875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 144/292] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:40.919082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.031854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8609ef-87f4-4ac2-98f1-7be24dfc2ab5 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.072995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.073918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.074199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.074471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.075765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:41.077270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:41.079360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 149/293] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:40 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:41.084112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50908d2-d128-400d-8768-fed9fc0ed7f2 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.084398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50908d2-d128-400d-8768-fed9fc0ed7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.084719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50908d2-d128-400d-8768-fed9fc0ed7f2 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.086221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 145/294] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:41.087285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.110292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28059a45-7fcb-4d2b-ac05-f6be32e6e280 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.110573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28059a45-7fcb-4d2b-ac05-f6be32e6e280 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.111016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28059a45-7fcb-4d2b-ac05-f6be32e6e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.149411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-28059a45-7fcb-4d2b-ac05-f6be32e6e280 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:41.150845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-28059a45-7fcb-4d2b-ac05-f6be32e6e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:41.195603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1e1d9-ccc6-4450-a6e4-128d2f920da3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.231476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b796c-9e1a-425c-8bd5-1575e1967540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.232543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b796c-9e1a-425c-8bd5-1575e1967540 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.234120 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b796c-9e1a-425c-8bd5-1575e1967540 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.235023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b796c-9e1a-425c-8bd5-1575e1967540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.236009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b796c-9e1a-425c-8bd5-1575e1967540 None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=bb5ba2632de642abb41db7234fbc20fd) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:41.236835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b796c-9e1a-425c-8bd5-1575e1967540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:41.238952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b796c-9e1a-425c-8bd5-1575e1967540 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:41.252380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 150/295] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/role_assignments?user.id=bb5ba2632de642abb41db7234fbc20fd&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:41.287516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c700e8-14f1-4ef5-a287-778de9136e31 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.288470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c700e8-14f1-4ef5-a287-778de9136e31 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.288748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c700e8-14f1-4ef5-a287-778de9136e31 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.290768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 151/296] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:41.297406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f50d-881e-489c-8931-707a98051a45 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.297954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f50d-881e-489c-8931-707a98051a45 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.298373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f50d-881e-489c-8931-707a98051a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.308210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 146/297] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:41.309597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f39bf-f517-445f-8fce-a7f1eb20b5f3 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.309884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f39bf-f517-445f-8fce-a7f1eb20b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.310155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f39bf-f517-445f-8fce-a7f1eb20b5f3 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.311449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 147/298] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:41.330753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b084f-5b65-48f0-b3c5-778a2521e2a7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.330995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b084f-5b65-48f0-b3c5-778a2521e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.331213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b084f-5b65-48f0-b3c5-778a2521e2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.333637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b958f50d-881e-489c-8931-707a98051a45 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:41.335135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b958f50d-881e-489c-8931-707a98051a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:41.350855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-566b084f-5b65-48f0-b3c5-778a2521e2a7 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:41.352453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-566b084f-5b65-48f0-b3c5-778a2521e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:41.424790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 152/299] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:41.425817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958f50d-881e-489c-8931-707a98051a45 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.427287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 148/300] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:41.449140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b084f-5b65-48f0-b3c5-778a2521e2a7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.558825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958f50d-881e-489c-8931-707a98051a45 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.564616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b084f-5b65-48f0-b3c5-778a2521e2a7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.590937 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.591659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.591936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.592205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.598698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.599483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.599762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.600034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.603465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:41.610212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:41.610981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:41.611825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:41.612619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 153/301] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:41.613301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:41.622916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:41.623797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:41.624590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 149/302] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:41.625839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.711710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572b0e3-9846-43a2-ba82-8a38955303c1 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.720675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17babb6f-44ec-42f3-a468-060ae9e8e795 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.743916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.744706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.744993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.745265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.746475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:41.747904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:41.749533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 154/303] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:41.750296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.759155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.760023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.760459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.760733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.761496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:41.761853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:41.763213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:41.771870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 150/304] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:41.777382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.851641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd29320-07dc-4648-8a95-d8f1215ac6f7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.875328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5104-a11f-48c9-b33c-0eee78082aa9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:41.882903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.883567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.883847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.884119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.884853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] RBAC: Adding query filter params (name=reader) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:41.885160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:41.886624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:41.894411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 155/305] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:41.899969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:41.908268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:41.908941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:41.909223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:41.909517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] PATH_INFO: `/v3/groups` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:41.910195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:41.911609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:41.937490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 151/306] 10.222.0.69 () {60 vars in 1134 bytes} [Wed May 4 18:52:41 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:41.937490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:42.031691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b421b-f78d-435c-b833-bc74543b2afb None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:42.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9b14c-0ac7-4607-9ec8-8830ca90eed4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:42.068533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:42.070128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:42.070495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:42.070827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] PATH_INFO: `/v3/users/8f157f851411407ca90b780d00550e30` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:42.072232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] RBAC: Authorizing `identity:get_user(user_id=8f157f851411407ca90b780d00550e30)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:42.073908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:42.075852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 156/307] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/users/8f157f851411407ca90b780d00550e30 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:42.081399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:42.086447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:42.087420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:42.087763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:42.088103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] PATH_INFO: `/v3/users/554bb75a1a0f43a99b4bcb8d2d12a4dd` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:42.102950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=554bb75a1a0f43a99b4bcb8d2d12a4dd)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:42.104449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:42.106309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 152/308] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:41 2022] GET /identity/v3/users/554bb75a1a0f43a99b4bcb8d2d12a4dd => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:42.114498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:42.204316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8f4a-e3d4-48a2-9835-d4234f139262 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:42.241410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a497-798e-4345-913c-05a8462c2bd8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:42.247217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e2346-b244-4dc7-a1d6-79bc3fc606c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:42.248082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2346-b244-4dc7-a1d6-79bc3fc606c2 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:42.248359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2346-b244-4dc7-a1d6-79bc3fc606c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:42.248631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2346-b244-4dc7-a1d6-79bc3fc606c2 None admin] PATH_INFO: `/v3/system/users/8f157f851411407ca90b780d00550e30/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:42.250128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e2346-b244-4dc7-a1d6-79bc3fc606c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8f157f851411407ca90b780d00550e30, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:42.251954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e2346-b244-4dc7-a1d6-79bc3fc606c2 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:42.273537 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 157/309] 10.222.0.69 () {58 vars in 1334 bytes} [Wed May 4 18:52:42 2022] PUT /identity/v3/system/users/8f157f851411407ca90b780d00550e30/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:52:42.286711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f13b99-998c-467a-843b-87aea474ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:42.287380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13b99-998c-467a-843b-87aea474ff43 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:42.287691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13b99-998c-467a-843b-87aea474ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:42.287960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13b99-998c-467a-843b-87aea474ff43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:42.288802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f13b99-998c-467a-843b-87aea474ff43 None admin] RBAC: Adding query filter params (role.id=2dad68677730476daa6171ba3da694aa, user.id=554bb75a1a0f43a99b4bcb8d2d12a4dd, scope.system=all) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:42.289095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f13b99-998c-467a-843b-87aea474ff43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:42.290615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f13b99-998c-467a-843b-87aea474ff43 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:42.296948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 153/310] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 18:52:42 2022] GET /identity/v3/role_assignments?user.id=554bb75a1a0f43a99b4bcb8d2d12a4dd&scope.system=all&role.id=2dad68677730476daa6171ba3da694aa => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:42.601598 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbd4f-84d1-46c0-a085-293b457aaf68 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:42.601996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbd4f-84d1-46c0-a085-293b457aaf68 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:42.602171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbd4f-84d1-46c0-a085-293b457aaf68 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:42.603795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 158/311] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:42.608931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04a06-afd5-481a-8d86-8218d4dea055 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:42.609368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04a06-afd5-481a-8d86-8218d4dea055 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:42.609490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04a06-afd5-481a-8d86-8218d4dea055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:42.626605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-52b04a06-afd5-481a-8d86-8218d4dea055 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:42.627795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-52b04a06-afd5-481a-8d86-8218d4dea055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:42.697979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 154/312] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:42.720760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebbd4f-84d1-46c0-a085-293b457aaf68 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:42.822625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebbd4f-84d1-46c0-a085-293b457aaf68 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:42.856157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:42.856870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:42.857142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:42.857407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:42.868155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:42.875928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:42.876798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:42.877610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:42.881578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 159/313] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:42.883267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b04a06-afd5-481a-8d86-8218d4dea055 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:42.991985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b04a06-afd5-481a-8d86-8218d4dea055 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:43.025977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:43.026637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:43.026961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:43.027231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:43.027962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:43.028258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:43.029625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:43.038439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 155/314] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:43.044172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:43.152448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7a02-e0c4-454b-b501-e6e8fa1507ec None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:43.187766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:43.188641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:43.188916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:43.189183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] PATH_INFO: `/v3/users/6dacca519b8745ca9a52a4f49fab774d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:43.190390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] RBAC: Authorizing `identity:get_user(user_id=6dacca519b8745ca9a52a4f49fab774d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:43.191808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:43.197577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 160/315] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:43 2022] GET /identity/v3/users/6dacca519b8745ca9a52a4f49fab774d => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:43.199395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:43.298151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2b1fe-020f-459d-843f-330ba26ac8dc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:43.333001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:43.333677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:43.333958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:43.334226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:43.404337 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:43.405728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:43.512124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 156/316] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:43.513485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:43.611374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2238fd2-554f-4b92-b6aa-fca59c43535c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:43.649771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34687eee-b479-4271-a250-e0267e62d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:43.650730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34687eee-b479-4271-a250-e0267e62d43f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:43.651012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34687eee-b479-4271-a250-e0267e62d43f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:43.651284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34687eee-b479-4271-a250-e0267e62d43f None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:43.652447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34687eee-b479-4271-a250-e0267e62d43f None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:43.653910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34687eee-b479-4271-a250-e0267e62d43f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:43.655641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 161/317] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:43 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:43.661603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:43.761981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041435aa-68ae-4467-9f85-805384efd7aa None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:43.795889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a5dc-328d-47ae-8e7d-24e13823f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:43.796544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a5dc-328d-47ae-8e7d-24e13823f004 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:43.796818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a5dc-328d-47ae-8e7d-24e13823f004 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:43.797089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a5dc-328d-47ae-8e7d-24e13823f004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:43.797947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803a5dc-328d-47ae-8e7d-24e13823f004 None admin] RBAC: Adding query filter params (role.id=2dad68677730476daa6171ba3da694aa, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf, user.id=6dacca519b8745ca9a52a4f49fab774d) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:43.798252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803a5dc-328d-47ae-8e7d-24e13823f004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:43.799673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803a5dc-328d-47ae-8e7d-24e13823f004 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:43.810124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 157/318] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:52:43 2022] GET /identity/v3/role_assignments?user.id=6dacca519b8745ca9a52a4f49fab774d&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=2dad68677730476daa6171ba3da694aa => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:44.326091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6a24-b0b8-4c67-a9f7-2dedb7b1e7a4 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.326635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6a24-b0b8-4c67-a9f7-2dedb7b1e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.326635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6a24-b0b8-4c67-a9f7-2dedb7b1e7a4 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.328000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 162/319] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:44.333110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365367d-e243-47f8-a4c5-a82a933406e2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.333399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365367d-e243-47f8-a4c5-a82a933406e2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.333704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365367d-e243-47f8-a4c5-a82a933406e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.349846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a365367d-e243-47f8-a4c5-a82a933406e2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:44.351553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a365367d-e243-47f8-a4c5-a82a933406e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:44.421974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 158/320] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:44.444761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f6a24-b0b8-4c67-a9f7-2dedb7b1e7a4 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:44.544469 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f6a24-b0b8-4c67-a9f7-2dedb7b1e7a4 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:44.577115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba49cfd-eb90-4cc7-9cce-01108c005bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:44.577853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49cfd-eb90-4cc7-9cce-01108c005bd2 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.578132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49cfd-eb90-4cc7-9cce-01108c005bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.578400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49cfd-eb90-4cc7-9cce-01108c005bd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.579547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba49cfd-eb90-4cc7-9cce-01108c005bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:44.580976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba49cfd-eb90-4cc7-9cce-01108c005bd2 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:44.582831 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 163/321] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:52:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:44.586422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b29ea0-74b0-46b8-b27a-f4e33def9f73 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.586712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b29ea0-74b0-46b8-b27a-f4e33def9f73 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.586807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3899-3030-4c0e-a09a-4030e21a67ed None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.586989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b29ea0-74b0-46b8-b27a-f4e33def9f73 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.587085 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3899-3030-4c0e-a09a-4030e21a67ed None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.587384 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3899-3030-4c0e-a09a-4030e21a67ed None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.588500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 159/322] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:44.588848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 164/323] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:44.589044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b29ea0-74b0-46b8-b27a-f4e33def9f73 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:44.593302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e46af-ee1f-4955-a813-aa182e48095c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.593627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e46af-ee1f-4955-a813-aa182e48095c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.593914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e46af-ee1f-4955-a813-aa182e48095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.609965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-335e46af-ee1f-4955-a813-aa182e48095c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:44.611138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-335e46af-ee1f-4955-a813-aa182e48095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:44.673126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 165/324] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:44.674381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846b0a-d059-40cc-80ab-715aa124683c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.674668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846b0a-d059-40cc-80ab-715aa124683c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.674946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846b0a-d059-40cc-80ab-715aa124683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.685316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b29ea0-74b0-46b8-b27a-f4e33def9f73 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:44.690334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f7846b0a-d059-40cc-80ab-715aa124683c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:44.691505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f7846b0a-d059-40cc-80ab-715aa124683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:44.718060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:44.718712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.718990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.719259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] PATH_INFO: `/v3/groups` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.719930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:44.721356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:44.736063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 160/325] 10.222.0.69 () {60 vars in 1134 bytes} [Wed May 4 18:52:44 2022] POST /identity/v3/groups => generated 226 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:52:44.736875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:44.761683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 166/326] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:44.783587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846b0a-d059-40cc-80ab-715aa124683c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:44.848297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7a93a-07e9-4672-a36c-012e03057c07 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:44.883179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846b0a-d059-40cc-80ab-715aa124683c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:44.883384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:44.884137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.884410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.884707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.895710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:44.903994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:44.904981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:44.905820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 161/327] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:44.911194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:44.922169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:44.922972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:44.923249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:44.923522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:44.937610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:44.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:44.947318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:44.948154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 167/328] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:44.958394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:45.037964 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692759c-f71f-4c6a-ad6a-9322286a36e3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:45.071921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20733-18b7-4f10-a2a0-b1026224220d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:45.084026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:45.085277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:45.085968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:45.086257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:45.087041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:45.087352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:45.088740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:45.098890 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 162/329] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:45.104539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:45.113024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:45.114434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:45.114855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:45.115274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:45.116216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:45.117532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:45.120858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:45.132338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 168/330] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:45.137924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:45.221732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5390a-c55a-476e-8cfe-7854857f210e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:45.256090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:45.257046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda169e6-c28f-46f9-a2c1-0a6e7c3e1eba None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:45.258154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:45.258731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:45.259204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] PATH_INFO: `/v3/users/554bb75a1a0f43a99b4bcb8d2d12a4dd` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:45.260707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] RBAC: Authorizing `identity:get_user(user_id=554bb75a1a0f43a99b4bcb8d2d12a4dd)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:45.262401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:45.264569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 163/331] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:45 2022] GET /identity/v3/users/554bb75a1a0f43a99b4bcb8d2d12a4dd => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:45.270004 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:45.300642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:45.301704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:45.301990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:45.302267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] PATH_INFO: `/v3/users/8f157f851411407ca90b780d00550e30` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:45.304209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=8f157f851411407ca90b780d00550e30)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:45.306834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:45.308767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 169/332] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:45 2022] GET /identity/v3/users/8f157f851411407ca90b780d00550e30 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:45.314400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:45.377195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dad909-eb3f-40dd-95fc-1ab35322664d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:45.412470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897e67-9370-409f-a139-e1c445ad3653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:45.413375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897e67-9370-409f-a139-e1c445ad3653 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:45.413682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897e67-9370-409f-a139-e1c445ad3653 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:45.413957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897e67-9370-409f-a139-e1c445ad3653 None admin] PATH_INFO: `/v3/system/users/554bb75a1a0f43a99b4bcb8d2d12a4dd/roles/2dad68677730476daa6171ba3da694aa` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:45.415908 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897e67-9370-409f-a139-e1c445ad3653 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=554bb75a1a0f43a99b4bcb8d2d12a4dd, role_id=2dad68677730476daa6171ba3da694aa)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:45.417284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897e67-9370-409f-a139-e1c445ad3653 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:45.418710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66f817-f8fd-4de6-b39b-7a4cc4367eb2 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:45.430248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 164/333] 10.222.0.69 () {58 vars in 1334 bytes} [Wed May 4 18:52:45 2022] PUT /identity/v3/system/users/554bb75a1a0f43a99b4bcb8d2d12a4dd/roles/2dad68677730476daa6171ba3da694aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:45.456685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74aecd-c368-4437-af84-35540f497191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:45.457399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74aecd-c368-4437-af84-35540f497191 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:45.457721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74aecd-c368-4437-af84-35540f497191 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:45.458003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74aecd-c368-4437-af84-35540f497191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:45.458891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74aecd-c368-4437-af84-35540f497191 None admin] RBAC: Adding query filter params (role.id=6a66b6a23fc641d6bc44da62f92e5825, user.id=8f157f851411407ca90b780d00550e30, scope.system=all) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:45.459208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74aecd-c368-4437-af84-35540f497191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:45.460828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74aecd-c368-4437-af84-35540f497191 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:45.479350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 170/334] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 18:52:45 2022] GET /identity/v3/role_assignments?user.id=8f157f851411407ca90b780d00550e30&scope.system=all&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:47.349506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cf754-5b89-44f8-a403-480740d0eeee None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:47.350549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cf754-5b89-44f8-a403-480740d0eeee None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:47.350549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cf754-5b89-44f8-a403-480740d0eeee None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:47.352094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 165/335] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:47.357380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f418d38-0f74-46c5-a1e7-4ba45a177404 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:47.357854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f418d38-0f74-46c5-a1e7-4ba45a177404 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:47.358039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f418d38-0f74-46c5-a1e7-4ba45a177404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:47.378443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7f418d38-0f74-46c5-a1e7-4ba45a177404 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:47.379637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7f418d38-0f74-46c5-a1e7-4ba45a177404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:47.460600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 171/336] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:47.499652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f418d38-0f74-46c5-a1e7-4ba45a177404 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:47.499836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232d1f-3bef-4e80-802f-d3b38746a499 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:47.500047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232d1f-3bef-4e80-802f-d3b38746a499 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:47.500331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232d1f-3bef-4e80-802f-d3b38746a499 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:47.502011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 166/337] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:47.523918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6a06-5234-404d-a7f4-52c4328360a7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:47.524203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6a06-5234-404d-a7f4-52c4328360a7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:47.524480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6a06-5234-404d-a7f4-52c4328360a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:47.558523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-442a6a06-5234-404d-a7f4-52c4328360a7 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:47.559726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-442a6a06-5234-404d-a7f4-52c4328360a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:47.601946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f418d38-0f74-46c5-a1e7-4ba45a177404 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:47.647132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:47.647945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:47.648225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:47.648494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:47.652762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 167/338] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:47.666332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:47.676629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6a06-5234-404d-a7f4-52c4328360a7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:47.678595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:47.680667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:47.682686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 172/339] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:47.689491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:47.778846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6a06-5234-404d-a7f4-52c4328360a7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:47.814771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:47.815586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:47.815864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:47.816136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:47.827343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:47.835471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:47.837206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 168/340] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:47.844374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:47.870849 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c3dd4-5464-4bff-b255-ba1f185ddc5d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:47.947068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:47.948118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:47.948605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:47.949081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:47.950063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:47.950574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:47.952148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:47.971968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 173/341] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:47.977708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:48.051405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced5636-c034-423d-95bf-d64ad713c35d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:48.115641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:48.116838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.117118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.117390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.118183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:48.118489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:48.119876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:48.128700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 169/342] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:48.134423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:48.172238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac96136-1abb-447f-9434-ec6b7c5ffece None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:48.239147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:48.239868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.240153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.240427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.259127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bd994-aa17-4754-b600-aaa4ea918912 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:48.300092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:48.301072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.301574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.301996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.355982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:48.357765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:48.376298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:48.378346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:48.481643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 170/343] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:52:48.487577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:48.551743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 174/344] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:52:48.564488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:48.667560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ad6a2-a771-4f07-89d0-2aa2f52c08cb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:48.721325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac68954-c2b8-467f-8dcb-118828d799fb None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:48.735809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390afa4-9f7e-43c5-b97f-53eb3abf00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:48.737181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390afa4-9f7e-43c5-b97f-53eb3abf00de None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.737455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390afa4-9f7e-43c5-b97f-53eb3abf00de None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.737757 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390afa4-9f7e-43c5-b97f-53eb3abf00de None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.739119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390afa4-9f7e-43c5-b97f-53eb3abf00de None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:48.740614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390afa4-9f7e-43c5-b97f-53eb3abf00de None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:48.742703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 171/345] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:48 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:48.744211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8851ae6-45c3-4807-bd11-e48d8f03b6a8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.744699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8851ae6-45c3-4807-bd11-e48d8f03b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.745164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8851ae6-45c3-4807-bd11-e48d8f03b6a8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.750681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 172/346] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:48.751662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8851ae6-45c3-4807-bd11-e48d8f03b6a8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:48.788404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1429-26c1-40c8-9eb2-ab771be88ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:48.789668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1429-26c1-40c8-9eb2-ab771be88ed6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.790145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1429-26c1-40c8-9eb2-ab771be88ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.790610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1429-26c1-40c8-9eb2-ab771be88ed6 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.792616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca1429-26c1-40c8-9eb2-ab771be88ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:48.794271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca1429-26c1-40c8-9eb2-ab771be88ed6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:48.798494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 175/347] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:48 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:48.800801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02dbe-f87a-45eb-ba3e-2b896ce6fa74 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.802304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02dbe-f87a-45eb-ba3e-2b896ce6fa74 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.803448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02dbe-f87a-45eb-ba3e-2b896ce6fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.831943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5cb02dbe-f87a-45eb-ba3e-2b896ce6fa74 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:48.834953 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5cb02dbe-f87a-45eb-ba3e-2b896ce6fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:48.926495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8851ae6-45c3-4807-bd11-e48d8f03b6a8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:48.967084 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:48.968639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:48.969153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:48.969629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:48.976169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:48.977043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 176/348] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:48.978485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:48.978567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02dbe-f87a-45eb-ba3e-2b896ce6fa74 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:48.979876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 173/349] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:48 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:48.986582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:49.096268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae142-f0fd-4ec5-9902-7a1ad056eade None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.108359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02dbe-f87a-45eb-ba3e-2b896ce6fa74 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.132730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.133647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.134070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.134507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.135476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=4bed9b3587c1435482592b924abd1a89) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:49.135956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:49.137546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:49.145575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 174/350] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:48 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:49.146713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:49.152325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7d4d-eb9d-4b0d-b3ef-109d4957d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.153503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7d4d-eb9d-4b0d-b3ef-109d4957d986 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.153928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7d4d-eb9d-4b0d-b3ef-109d4957d986 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.154422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7d4d-eb9d-4b0d-b3ef-109d4957d986 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.156036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c7d4d-eb9d-4b0d-b3ef-109d4957d986 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:49.158393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c7d4d-eb9d-4b0d-b3ef-109d4957d986 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:49.161252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 177/351] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:48 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:49.166840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d1b9-30fc-4420-b744-b6f1233bf48b None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.167144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d1b9-30fc-4420-b744-b6f1233bf48b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.167411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d1b9-30fc-4420-b744-b6f1233bf48b None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.170798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 178/352] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:49.172440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d1b9-30fc-4420-b744-b6f1233bf48b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:49.287473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2335a-9419-488a-bbda-3d1389b2ca10 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.332815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719cab-ef9e-4bfe-addb-24507582aaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.333966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719cab-ef9e-4bfe-addb-24507582aaba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.334442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719cab-ef9e-4bfe-addb-24507582aaba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.334859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719cab-ef9e-4bfe-addb-24507582aaba None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.337737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d1b9-30fc-4420-b744-b6f1233bf48b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.348527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719cab-ef9e-4bfe-addb-24507582aaba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7e719cab-ef9e-4bfe-addb-24507582aaba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:49.357759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:49.358939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:49.359950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:49.367084 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 175/353] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:49.369158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc7fe-ab9e-4ab7-be67-dd8982fa81b2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.369628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc7fe-ab9e-4ab7-be67-dd8982fa81b2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.370089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc7fe-ab9e-4ab7-be67-dd8982fa81b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.393201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-077dc7fe-ab9e-4ab7-be67-dd8982fa81b2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:49.395946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-077dc7fe-ab9e-4ab7-be67-dd8982fa81b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:49.419169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.419839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.420122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.420399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.421232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=4bed9b3587c1435482592b924abd1a89) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:49.421674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:49.423104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:49.429366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 179/354] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:49 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:49.430255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:49.483684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 176/355] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:49.509413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc7fe-ab9e-4ab7-be67-dd8982fa81b2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:49.561271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357dc3-7042-4650-8986-77b01d58fdb9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.609874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd912a84-2186-42be-b0b1-c633c58a041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.610686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd912a84-2186-42be-b0b1-c633c58a041a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.610973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd912a84-2186-42be-b0b1-c633c58a041a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.611252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd912a84-2186-42be-b0b1-c633c58a041a None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.612541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd912a84-2186-42be-b0b1-c633c58a041a None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:49.612868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd912a84-2186-42be-b0b1-c633c58a041a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:49.614641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd912a84-2186-42be-b0b1-c633c58a041a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:49.628125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 180/356] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:49.629670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a52487-66a5-41f6-a8c7-dab3c475eb93 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.629962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a52487-66a5-41f6-a8c7-dab3c475eb93 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.630235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a52487-66a5-41f6-a8c7-dab3c475eb93 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.631796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 181/357] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:49.636795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d48d-3a17-42b4-98ad-31fcaf0ed3c1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.637152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d48d-3a17-42b4-98ad-31fcaf0ed3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.637873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d48d-3a17-42b4-98ad-31fcaf0ed3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.640189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc7fe-ab9e-4ab7-be67-dd8982fa81b2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.663249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ff12d48d-3a17-42b4-98ad-31fcaf0ed3c1 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:49.664757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ff12d48d-3a17-42b4-98ad-31fcaf0ed3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:49.684394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.685257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.685569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.685849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.697749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:49.707486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:49.708452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:49.709415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 177/358] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:49.710147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:49.765375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 182/359] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:49.766407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d48d-3a17-42b4-98ad-31fcaf0ed3c1 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:49.844483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dc1d2-b050-42ff-920e-21917181560e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.887750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d48d-3a17-42b4-98ad-31fcaf0ed3c1 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:49.928469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.929518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.930009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.930487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.949083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:49.950131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:49.950654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:49.951133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:49.952083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:49.952594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:49.954199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:49.979455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 183/360] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:49.980639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.060706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:50.063885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:50.197272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 178/361] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:50.198584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.199464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b4023-845e-4c28-8093-5e8290500854 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.262188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.263021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.263491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.263903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.277758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:50.286092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:50.287110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:50.288142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:50.291949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 184/362] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:50.292926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.307837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44416ae-f677-49a5-8683-daf01526fa17 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.347542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.348744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.349117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.349986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] PATH_INFO: `/v3/users/554bb75a1a0f43a99b4bcb8d2d12a4dd` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.352766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=554bb75a1a0f43a99b4bcb8d2d12a4dd)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:50.354567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:50.356479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 179/363] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/users/554bb75a1a0f43a99b4bcb8d2d12a4dd => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:50.357651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.425130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0125a5-5a17-4bfd-83f0-93b8b2d727e0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.468553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10670-5261-4cf2-9e88-c5181315aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.469445 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10670-5261-4cf2-9e88-c5181315aa9e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.469807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10670-5261-4cf2-9e88-c5181315aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.470148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10670-5261-4cf2-9e88-c5181315aa9e None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.470704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c249f-ae06-4378-93d2-5ea02548a2f5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.471470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10670-5261-4cf2-9e88-c5181315aa9e None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:50.473127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10670-5261-4cf2-9e88-c5181315aa9e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:50.475758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 185/364] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:50.478517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17ea9a-4fcd-4cc0-bb59-eca324970dc7 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.478517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17ea9a-4fcd-4cc0-bb59-eca324970dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.478517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17ea9a-4fcd-4cc0-bb59-eca324970dc7 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.479426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 186/365] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:50.480204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17ea9a-4fcd-4cc0-bb59-eca324970dc7 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.514039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aa32f-cf5c-4584-9df5-f0ab0e85cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.515036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa32f-cf5c-4584-9df5-f0ab0e85cf68 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.515530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa32f-cf5c-4584-9df5-f0ab0e85cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.515977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa32f-cf5c-4584-9df5-f0ab0e85cf68 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.516971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aa32f-cf5c-4584-9df5-f0ab0e85cf68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:50.517544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aa32f-cf5c-4584-9df5-f0ab0e85cf68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:50.519174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aa32f-cf5c-4584-9df5-f0ab0e85cf68 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:50.529700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 180/366] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:50.531513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b140a-6804-4b34-9071-4f31d4d4b046 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.532018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b140a-6804-4b34-9071-4f31d4d4b046 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.532497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b140a-6804-4b34-9071-4f31d4d4b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.554232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-dc1b140a-6804-4b34-9071-4f31d4d4b046 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:50.555797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dc1b140a-6804-4b34-9071-4f31d4d4b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:50.599001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17ea9a-4fcd-4cc0-bb59-eca324970dc7 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.629497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 181/367] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:50.630812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b140a-6804-4b34-9071-4f31d4d4b046 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.634325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.635520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.635520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.635520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.636329 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] RBAC: Adding query filter params (role.id=2dad68677730476daa6171ba3da694aa, user.id=554bb75a1a0f43a99b4bcb8d2d12a4dd, scope.system=all) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:50.636631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:50.639548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:50.652202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 187/368] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/role_assignments?user.id=554bb75a1a0f43a99b4bcb8d2d12a4dd&scope.system=all&role.id=2dad68677730476daa6171ba3da694aa => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:50.652889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.739204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b140a-6804-4b34-9071-4f31d4d4b046 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.755738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa4ebc-8d9f-48b9-a0b5-fea2c43c3e31 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.778130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.779470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.780017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.780501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.782132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:50.783876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:50.789632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 182/369] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:50.790978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.794331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.795665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.795665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.795665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.867368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:50.868861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:50.901223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa59b5-6a1a-49e2-9605-2f6c842a1150 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:50.938698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:50.939900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:50.940394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:50.940888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:50.953045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:50.961323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:50.962335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:50.963234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:50.966181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 183/370] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:50.967344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:50.973656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 188/371] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:50.974510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:51.082902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2f221-b24e-4278-bc70-c9c846fe1741 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.087663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186d6e9-8024-457d-ae18-d229b795e9cb None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.128903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.129976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.130449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.130817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.131766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.131906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:51.132249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.132895 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.133312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.133747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.134012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.134886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:51.135353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.137165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.144372 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 184/372] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:51.145897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 189/373] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:51.146625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:51.151491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:51.278504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fbf75-67de-4277-9c26-92e3c76dd472 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.318068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.319029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.319949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.320392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.392041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c8b9d-1737-4789-91f0-14b557576a87 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.400402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.402190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.451063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.452149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.452566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.452937 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.454229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.455777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.459559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 190/374] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:51 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:51.465094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:51.510166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 185/375] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:52:51.515617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:51.575984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d255-5726-4299-bbe2-4d8a7fbecc90 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.609056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.610155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.610438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.610783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.612057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.613596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.616105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 191/376] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:51 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:51.618433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc1f8-6195-430e-b819-439de5e658b3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.622403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:51.698235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.699357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.699787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.700208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] PATH_INFO: `/v3/projects/75aca24ee457414ebddf524e98cb22af` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.701657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] RBAC: Authorizing `identity:get_project(project_id=75aca24ee457414ebddf524e98cb22af)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.703225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.705107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 186/377] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:51 2022] GET /identity/v3/projects/75aca24ee457414ebddf524e98cb22af => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:51.710567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:51.792610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b9f5d-dc48-480e-ba86-2571427fafc4 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.827089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.828007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.828450 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.828873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.829883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:51.830352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.831919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.840285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 192/378] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:51 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:51.896860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fed7a-9109-4b4b-9612-ddce84737246 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:51.945457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c60a42-19b9-4841-90cb-c25a3a1b297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:51.946339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c60a42-19b9-4841-90cb-c25a3a1b297c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:51.946619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c60a42-19b9-4841-90cb-c25a3a1b297c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:51.946894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c60a42-19b9-4841-90cb-c25a3a1b297c None admin] PATH_INFO: `/v3/groups/14f11ef0879e4c8bab85f7e61eae7da3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:51.954802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c60a42-19b9-4841-90cb-c25a3a1b297c None admin] RBAC: Authorizing `identity:get_group(group_id=14f11ef0879e4c8bab85f7e61eae7da3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:51.956181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c60a42-19b9-4841-90cb-c25a3a1b297c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:51.958224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 187/379] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:51 2022] GET /identity/v3/groups/14f11ef0879e4c8bab85f7e61eae7da3 => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:51.965505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:52.101671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb0ab-6baf-4d21-83c3-1427e9d9372e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:52.144098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb570a6-ca03-40a3-9df1-40e9050dc5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:52.144768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb570a6-ca03-40a3-9df1-40e9050dc5b5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:52.145049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb570a6-ca03-40a3-9df1-40e9050dc5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:52.145602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb570a6-ca03-40a3-9df1-40e9050dc5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:52.146438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb570a6-ca03-40a3-9df1-40e9050dc5b5 None admin] RBAC: Adding query filter params (group.id=14f11ef0879e4c8bab85f7e61eae7da3, role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=75aca24ee457414ebddf524e98cb22af) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:52.147286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb570a6-ca03-40a3-9df1-40e9050dc5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:52.148727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb570a6-ca03-40a3-9df1-40e9050dc5b5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:52.155863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 193/380] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:51 2022] GET /identity/v3/role_assignments?group.id=14f11ef0879e4c8bab85f7e61eae7da3&scope.project.id=75aca24ee457414ebddf524e98cb22af&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:52.458841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654d779-7435-4c00-9e1b-392c7c69881d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:52.460117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654d779-7435-4c00-9e1b-392c7c69881d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:52.460611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654d779-7435-4c00-9e1b-392c7c69881d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:52.462754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 188/381] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:52.468932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056956-afaf-4ebc-8284-4b7824214af7 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:52.469976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056956-afaf-4ebc-8284-4b7824214af7 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:52.470456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056956-afaf-4ebc-8284-4b7824214af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:52.491216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d9056956-afaf-4ebc-8284-4b7824214af7 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:52.492795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d9056956-afaf-4ebc-8284-4b7824214af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:52.568374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 194/382] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:52.595860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654d779-7435-4c00-9e1b-392c7c69881d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:52.686794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a6d8-427b-4ea2-a1a5-06c824769f69 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:52.687108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a6d8-427b-4ea2-a1a5-06c824769f69 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:52.687347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a6d8-427b-4ea2-a1a5-06c824769f69 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:52.688854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 195/383] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:52:52.698472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4323-c99f-4cea-be66-68323d079806 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:52.698756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4323-c99f-4cea-be66-68323d079806 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:52.699021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4323-c99f-4cea-be66-68323d079806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:52.735471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-53cd4323-c99f-4cea-be66-68323d079806 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:52.738283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-53cd4323-c99f-4cea-be66-68323d079806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:52.761885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654d779-7435-4c00-9e1b-392c7c69881d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:52.833810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:52.834681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:52.834956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:52.835226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:52.856646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:52.866359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:52.867289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:52.868082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:52.873489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 189/384] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:52.879790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:52.888434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 196/385] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:52.912042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4323-c99f-4cea-be66-68323d079806 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:53.008558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722bf6c-aa5e-4117-8d23-7e945f3cc374 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.062656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.063927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.064427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.064954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.065965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:53.066472 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:53.068055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:53.082451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 190/386] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:53.088761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:53.089970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4323-c99f-4cea-be66-68323d079806 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.129550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.130358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.130640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.131003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.149949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:53.157966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:53.158859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:53.159679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:53.160771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 197/387] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:53.167764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:53.224122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd9be-3465-45cd-ac85-df266d469efc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.265990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.266791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.267065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.267331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.274363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:53.275832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:53.277889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 191/388] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:53 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:53.283241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:53.302528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcb482-71ac-4290-8c16-37b61f5bb7d9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.340861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.341903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.342187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.342468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.343224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:53.343531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:53.345636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:53.364062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 198/389] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:53.369420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:53.465825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81cca3-3ce8-4fac-a405-6fb40b02fee4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.492284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b34a3-115c-4cf7-a4e1-fff8beb6d46b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.515545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.516470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.516693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.516960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.522786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:53.524239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:53.526316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 192/390] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:53 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:53.529704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.530557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.530831 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.531104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.532283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:53.533749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:53.543769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:53.547996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 199/391] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:53 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:53.552626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:53.687513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a870f6-17d9-4b82-bd99-3d18d42fa880 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.728127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.729017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.729292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.729584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.733123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] RBAC: Authorizing `identity:create_grant(project_id=4bed9b3587c1435482592b924abd1a89, group_id=c8d7d59fa93e470bafa81d6f5a7adf1a, role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:53.734580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:53.744336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291dbc0-76d3-4d6f-8234-2a0a30e1f684 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:53.765926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 193/392] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 18:52:53 2022] PUT /identity/v3/projects/4bed9b3587c1435482592b924abd1a89/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:52:53.810304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90370d-9b6a-49eb-9f78-10f499e1984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:53.811204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90370d-9b6a-49eb-9f78-10f499e1984b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:53.811484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90370d-9b6a-49eb-9f78-10f499e1984b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:53.811754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90370d-9b6a-49eb-9f78-10f499e1984b None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:53.813158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90370d-9b6a-49eb-9f78-10f499e1984b None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:53.814657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90370d-9b6a-49eb-9f78-10f499e1984b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:53.816626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 200/393] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:53 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:53.823778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:54.026243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25fa3-40de-4959-8a3a-a13548ce052a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:54.083382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae610c-a671-4aca-b834-26c17ef6a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:54.085201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae610c-a671-4aca-b834-26c17ef6a53b None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.085715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae610c-a671-4aca-b834-26c17ef6a53b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.086192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae610c-a671-4aca-b834-26c17ef6a53b None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.088471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae610c-a671-4aca-b834-26c17ef6a53b None admin] RBAC: Authorizing `identity:create_grant(project_id=4bed9b3587c1435482592b924abd1a89, group_id=c8d7d59fa93e470bafa81d6f5a7adf1a, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:54.090266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae610c-a671-4aca-b834-26c17ef6a53b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:54.118389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 194/394] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 18:52:53 2022] PUT /identity/v3/projects/4bed9b3587c1435482592b924abd1a89/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:54.258961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f37a-4a2b-45dc-a86f-93f284327859 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.259610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f37a-4a2b-45dc-a86f-93f284327859 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.260091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f37a-4a2b-45dc-a86f-93f284327859 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.262030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 201/395] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:54.273519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd7729-a93d-4e2b-a64a-3189cd076465 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.274160 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd7729-a93d-4e2b-a64a-3189cd076465 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.274649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd7729-a93d-4e2b-a64a-3189cd076465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.294838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b0dd7729-a93d-4e2b-a64a-3189cd076465 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:54.296494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b0dd7729-a93d-4e2b-a64a-3189cd076465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:54.382105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 195/396] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:54.407886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f37a-4a2b-45dc-a86f-93f284327859 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:54.542180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f37a-4a2b-45dc-a86f-93f284327859 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:54.590272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e77906-f060-4870-bcc5-10e8a452385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:54.591067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e77906-f060-4870-bcc5-10e8a452385b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.591342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e77906-f060-4870-bcc5-10e8a452385b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.591610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e77906-f060-4870-bcc5-10e8a452385b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.607867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e77906-f060-4870-bcc5-10e8a452385b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-50e77906-f060-4870-bcc5-10e8a452385b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:54.616100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:54.617002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:54.617820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 202/397] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:54.624510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd7729-a93d-4e2b-a64a-3189cd076465 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:54.704713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff0b5-b259-440d-a9bd-44a9f86432bf None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.705003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff0b5-b259-440d-a9bd-44a9f86432bf None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.705158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff0b5-b259-440d-a9bd-44a9f86432bf None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.706800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 203/398] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:54.760199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45d03-4356-4e16-b50c-1f71ae1eb613 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.760503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45d03-4356-4e16-b50c-1f71ae1eb613 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.760741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45d03-4356-4e16-b50c-1f71ae1eb613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.768355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd7729-a93d-4e2b-a64a-3189cd076465 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:54.790555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-69b45d03-4356-4e16-b50c-1f71ae1eb613 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:54.791739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-69b45d03-4356-4e16-b50c-1f71ae1eb613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:54.811822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:54.812496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.812772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.813043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.813816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:54.814120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:54.815491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:54.825116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 196/399] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:54.836700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:54.927830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 204/400] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:54.947018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dc61c-2f96-420e-8f7a-dbbefc8f0ae5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:54.966990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45d03-4356-4e16-b50c-1f71ae1eb613 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:54.982676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:54.983636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:54.983917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:54.984234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:54.985437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:54.986943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:54.988924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 197/401] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:54 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:54.994841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.101649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa241ab-d534-4861-a895-b22081359255 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.136159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.137027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.137350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.137646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.138833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:55.140250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:55.142276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 198/402] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:54 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:55.148817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.153738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45d03-4356-4e16-b50c-1f71ae1eb613 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.196032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.197224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.197826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.198314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.211907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:55.221492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:55.222467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:55.223265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:55.226724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 205/403] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:55.232760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.276660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96feccc-fc45-49c6-9e2f-df85d4f15c2d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.312955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673c16-f940-4071-bc4c-8dbbed613e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.314453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673c16-f940-4071-bc4c-8dbbed613e72 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.315310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673c16-f940-4071-bc4c-8dbbed613e72 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.316043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673c16-f940-4071-bc4c-8dbbed613e72 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.319041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673c16-f940-4071-bc4c-8dbbed613e72 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86ce6c4c1e94d8284541207da7bf7cf, group_id=c8d7d59fa93e470bafa81d6f5a7adf1a, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:55.320889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673c16-f940-4071-bc4c-8dbbed613e72 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:55.339736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 199/404] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 18:52:55 2022] PUT /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:55.341593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae6183-613f-42c2-8c3a-6fca08a0c3c7 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.342494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae6183-613f-42c2-8c3a-6fca08a0c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.343286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae6183-613f-42c2-8c3a-6fca08a0c3c7 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.345144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 200/405] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:55.354667 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cfa7-c2c6-484f-95f6-723c40520c41 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.355328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cfa7-c2c6-484f-95f6-723c40520c41 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.355816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cfa7-c2c6-484f-95f6-723c40520c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.376215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-65e0cfa7-c2c6-484f-95f6-723c40520c41 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:55.378366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-65e0cfa7-c2c6-484f-95f6-723c40520c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:55.383465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb1dcd-cb57-4b85-b140-884f9100b35d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.465195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 201/406] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:55.477522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.478142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.478542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.478829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.479596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:55.479902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:55.481300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:55.498326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cfa7-c2c6-484f-95f6-723c40520c41 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.499050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 206/407] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:55.507649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.625571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cfa7-c2c6-484f-95f6-723c40520c41 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.659070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71510556-425b-4227-b6d7-9df5dfc57180 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.670912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.672149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.672668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.673488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.687000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:55.694271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d142-1309-413a-a816-101062296bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.695313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d142-1309-413a-a816-101062296bdd None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.695668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d142-1309-413a-a816-101062296bdd None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.696005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d142-1309-413a-a816-101062296bdd None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:55.697388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:55.698283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:55.699072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:55.699670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036d142-1309-413a-a816-101062296bdd None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:55.699828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036d142-1309-413a-a816-101062296bdd None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:55.702272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 207/409] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:55 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:55.702476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 202/409] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:55.710915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.711058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d142-1309-413a-a816-101062296bdd None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.831134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21306f9a-1b4d-404d-b455-caaf67a9dc16 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.878158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.879044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.879318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.879591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.881734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:55.885902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:55.897182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 203/410] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:55 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:55.899606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:55.921867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d142-1309-413a-a816-101062296bdd None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:55.989715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:55.990920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:55.991197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:55.991466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:55.992204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:55.992503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:55.993897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:56.019191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 208/411] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:56.024763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:56.088177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fdf24-6e2e-48ce-9357-db8cf193f71a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:56.130338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:56.131879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:56.132151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:56.132464 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:56.141264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86ce6c4c1e94d8284541207da7bf7cf, group_id=c8d7d59fa93e470bafa81d6f5a7adf1a, role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:56.145440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:56.177606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 204/412] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 18:52:55 2022] PUT /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf/groups/c8d7d59fa93e470bafa81d6f5a7adf1a/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:56.243288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930865e-4748-4c7a-937f-b3b2dde153d9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:56.288288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:56.289587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:56.290073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:56.290545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] PATH_INFO: `/v3/groups/14f11ef0879e4c8bab85f7e61eae7da3` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:56.293229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] RBAC: Authorizing `identity:get_group(group_id=14f11ef0879e4c8bab85f7e61eae7da3)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:56.295061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:56.297666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 209/413] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:56 2022] GET /identity/v3/groups/14f11ef0879e4c8bab85f7e61eae7da3 => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:56.304081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:56.433209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a7ccb-60ca-49d4-a1d9-ecdad6d0f402 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:56.474516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66c705-94d9-482f-bf35-0769147ded22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:56.476027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c705-94d9-482f-bf35-0769147ded22 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:56.476305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c705-94d9-482f-bf35-0769147ded22 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:56.476644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c705-94d9-482f-bf35-0769147ded22 None admin] PATH_INFO: `/v3/projects/75aca24ee457414ebddf524e98cb22af` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:56.478493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66c705-94d9-482f-bf35-0769147ded22 None admin] RBAC: Authorizing `identity:get_project(project_id=75aca24ee457414ebddf524e98cb22af)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:56.480855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66c705-94d9-482f-bf35-0769147ded22 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:56.486916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 205/414] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:56 2022] GET /identity/v3/projects/75aca24ee457414ebddf524e98cb22af => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:56.493214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:56.670677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fbb8d-7a20-4eac-82be-f7064970faa3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:56.722218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9443c8-91dc-4ed2-8ae4-5d9e9cd88e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:56.723039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9443c8-91dc-4ed2-8ae4-5d9e9cd88e3e None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:56.723315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9443c8-91dc-4ed2-8ae4-5d9e9cd88e3e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:56.723584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9443c8-91dc-4ed2-8ae4-5d9e9cd88e3e None admin] PATH_INFO: `/v3/projects/75aca24ee457414ebddf524e98cb22af/groups/14f11ef0879e4c8bab85f7e61eae7da3/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:56.730310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9443c8-91dc-4ed2-8ae4-5d9e9cd88e3e None admin] RBAC: Authorizing `identity:create_grant(project_id=75aca24ee457414ebddf524e98cb22af, group_id=14f11ef0879e4c8bab85f7e61eae7da3, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:56.731759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9443c8-91dc-4ed2-8ae4-5d9e9cd88e3e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:56.751358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 210/415] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 18:52:56 2022] PUT /identity/v3/projects/75aca24ee457414ebddf524e98cb22af/groups/14f11ef0879e4c8bab85f7e61eae7da3/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:52:56.898935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9854-3ba2-44b9-ba14-c7a90fd31c0d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:56.899486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9854-3ba2-44b9-ba14-c7a90fd31c0d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:56.899486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9854-3ba2-44b9-ba14-c7a90fd31c0d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:56.901225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 206/416] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:56.906645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ac94-6737-42fc-a3a0-41b3127e8bec None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:56.906969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ac94-6737-42fc-a3a0-41b3127e8bec None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:56.907184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ac94-6737-42fc-a3a0-41b3127e8bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:56.929620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-bb49ac94-6737-42fc-a3a0-41b3127e8bec None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:56.930834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bb49ac94-6737-42fc-a3a0-41b3127e8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:57.015543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 211/417] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:57.041230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9854-3ba2-44b9-ba14-c7a90fd31c0d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:57.178169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9854-3ba2-44b9-ba14-c7a90fd31c0d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:57.217758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:57.218558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.218832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.219095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.223863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9d6c-e3f8-40f4-9234-5d2b63f11b3c None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.224148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9d6c-e3f8-40f4-9234-5d2b63f11b3c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.224425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9d6c-e3f8-40f4-9234-5d2b63f11b3c None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.226104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 212/418] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:57.232586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:57.241099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:57.242056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:57.242858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:57.245130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f6e95-d418-455b-952a-6b5a633cf454 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.245344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f6e95-d418-455b-952a-6b5a633cf454 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.245659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f6e95-d418-455b-952a-6b5a633cf454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.245791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 207/419] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:57.255601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:57.281963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a51f6e95-d418-455b-952a-6b5a633cf454 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:57.283135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a51f6e95-d418-455b-952a-6b5a633cf454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:57.360702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d080-6dc4-4101-b298-cca751e68e4c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:57.400144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:57.401016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.401296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.401600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.402340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:57.403723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:57.405818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:57.415575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 213/420] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:57.421501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 208/421] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:57.427121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f6e95-d418-455b-952a-6b5a633cf454 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:57.475855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:57.539291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f6e95-d418-455b-952a-6b5a633cf454 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:57.573441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:57.574439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.574870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.575281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.639095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab8b0f-b802-4d5e-9b4a-fdbd4c63ab7f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:57.643483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:57.645114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:57.715202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:57.716006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.716285 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.716556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.744297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:57.745794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 214/422] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:57.751641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:57.755475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:57.756614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:57.757614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 209/423] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:57.770760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:57.853602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ffd86-45cb-4850-876e-c739ac2fbe0f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:57.887739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:57.888985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.889521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.889986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.891340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:57.892948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:57.895386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 215/424] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:57.900399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec611b-99d7-41fb-b036-5d4a414b5e08 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:57.901563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:57.951578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:57.952255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:57.952537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:57.952813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:57.953582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:57.953891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:57.955255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:57.989517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 210/425] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:57.994802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.004328 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314b66-f36a-45eb-8024-cdf0ace58dda None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.045505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.047119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.047619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.048114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.049545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:58.051248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:58.054142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 216/426] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:58.060200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.166932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf05d7-6560-4fac-bf61-5d14977bfd55 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.207456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a7940-7134-4228-8501-bfd66356b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.207790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7940-7134-4228-8501-bfd66356b35a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.208037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7940-7134-4228-8501-bfd66356b35a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.208312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7940-7134-4228-8501-bfd66356b35a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.209196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7940-7134-4228-8501-bfd66356b35a None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=4bed9b3587c1435482592b924abd1a89) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:58.212465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7940-7134-4228-8501-bfd66356b35a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:58.212465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7940-7134-4228-8501-bfd66356b35a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:58.218002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 217/427] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:58 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:58.219565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894c16f-6966-40e7-b64e-08d7458b4e0d None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.219949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894c16f-6966-40e7-b64e-08d7458b4e0d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.220594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894c16f-6966-40e7-b64e-08d7458b4e0d None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.221710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 218/428] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:58.228089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f327b-9515-43d0-806d-968204befd61 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.228089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f327b-9515-43d0-806d-968204befd61 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.228089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f327b-9515-43d0-806d-968204befd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.241236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1808a-ae94-4f6e-bc0a-57f8b2711355 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.248179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-798f327b-9515-43d0-806d-968204befd61 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:58.249555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-798f327b-9515-43d0-806d-968204befd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:58.285637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.286305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.286579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.286846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.364743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 219/429] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:58.404596 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:58.406148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:58.413243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f327b-9515-43d0-806d-968204befd61 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.521659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 211/430] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:52:58.523430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.568277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f327b-9515-43d0-806d-968204befd61 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.614732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.616108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.616535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.616868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.628554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:58.636562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01445ff-2117-4ebe-8396-6ed47df6a7c4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:58.640042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:58.640933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:52:58.641750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:58.642359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 220/431] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:58.647938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.674112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.675052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.675450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.675789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] PATH_INFO: `/v3/projects/4bed9b3587c1435482592b924abd1a89` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.677050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] RBAC: Authorizing `identity:get_project(project_id=4bed9b3587c1435482592b924abd1a89)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:58.679175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:58.685417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 212/432] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:58 2022] GET /identity/v3/projects/4bed9b3587c1435482592b924abd1a89 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:58.686601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.763722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf629e-3e59-4394-b476-844d8ec73af5 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.785374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9c5d-0b99-4f65-80bc-6ce39e67f4de None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.798475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.799151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.799434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.799711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.800459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] RBAC: Adding query filter params (name=member) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:58.800766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:58.802179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:58.810875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 221/433] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:52:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:58.816809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.820224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.821080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.821354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.821655 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.822820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:58.824256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:58.830776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 213/434] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:58 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:58.831966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:58.924569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5de9d-e666-4101-a69b-28a9f31e50ae None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.956281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed0e4c-fd9d-4601-9e66-e3bc56a871de None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:58.963202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.963202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.963202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.963202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.992083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:58.992739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:58.993019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:58.993293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:58.994159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=4bed9b3587c1435482592b924abd1a89) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:58.994469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:58.995920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:59.002209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 214/435] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:58 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=4bed9b3587c1435482592b924abd1a89&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:59.038534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:59.040021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:59.150622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 222/436] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:52:59.155931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.273060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51985ce-3f84-43f4-9476-702fa31aafa7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:59.307950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad963e-db71-44d7-8d74-0c847b7e86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:59.308837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad963e-db71-44d7-8d74-0c847b7e86b0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.309113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad963e-db71-44d7-8d74-0c847b7e86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.309383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad963e-db71-44d7-8d74-0c847b7e86b0 None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.310626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad963e-db71-44d7-8d74-0c847b7e86b0 None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:59.312061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad963e-db71-44d7-8d74-0c847b7e86b0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:59.314095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 215/437] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:59.320077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.413296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f658f-6d6f-4ecf-b843-c0a9eaa3cb52 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.413296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f658f-6d6f-4ecf-b843-c0a9eaa3cb52 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.413296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f658f-6d6f-4ecf-b843-c0a9eaa3cb52 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.414859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 216/438] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:59.420451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82fee-d900-430c-bb77-e1699256c614 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.420727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82fee-d900-430c-bb77-e1699256c614 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.421018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82fee-d900-430c-bb77-e1699256c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.423104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957fcf6-b2a6-41ea-bd42-a3e1fd322101 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:59.441543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8fb82fee-d900-430c-bb77-e1699256c614 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:59.442717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8fb82fee-d900-430c-bb77-e1699256c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:59.460354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe6442-626c-4ec6-9ebc-1b0d43e4a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:59.461216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe6442-626c-4ec6-9ebc-1b0d43e4a417 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.461943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe6442-626c-4ec6-9ebc-1b0d43e4a417 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.461943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe6442-626c-4ec6-9ebc-1b0d43e4a417 None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.463060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe6442-626c-4ec6-9ebc-1b0d43e4a417 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:59.464497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe6442-626c-4ec6-9ebc-1b0d43e4a417 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:59.466310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 223/439] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:52:59.467651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b3c25-f439-4cb1-809e-965c855a7409 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.468086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b3c25-f439-4cb1-809e-965c855a7409 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.468514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b3c25-f439-4cb1-809e-965c855a7409 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.469978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 224/440] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:52:59.472547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b3c25-f439-4cb1-809e-965c855a7409 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.527242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 217/441] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:52:59.533240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655215-7a36-459f-9b30-c3e232ccef30 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.533944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655215-7a36-459f-9b30-c3e232ccef30 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.533944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655215-7a36-459f-9b30-c3e232ccef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.555495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5e655215-7a36-459f-9b30-c3e232ccef30 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:52:59.556912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5e655215-7a36-459f-9b30-c3e232ccef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:52:59.583773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b3c25-f439-4cb1-809e-965c855a7409 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:59.622224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:59.622882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.623163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.623433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.624254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=6a66b6a23fc641d6bc44da62f92e5825, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:59.624568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:59.626024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:59.633241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 225/442] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=6a66b6a23fc641d6bc44da62f92e5825 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:59.637686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 218/443] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:52:59.637686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e655215-7a36-459f-9b30-c3e232ccef30 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.657486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.744057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e655215-7a36-459f-9b30-c3e232ccef30 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:59.771542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507505fc-4d74-4594-bdfa-5af4f68e877c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:59.781697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:59.782509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.782784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.783067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.796332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:59.805815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:59.806619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.806893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.807162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:59.807763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:59.808627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:52:59.809438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:52:59.811375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 219/444] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:52:59.817095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.818742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:52:59.826964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:52:59.827844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:52:59.828628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 226/445] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:52:59.834377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.928256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227315-ad5e-4b18-8566-64170492ecd0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:59.951896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60939c-25d5-46cd-b503-b40e3e14bd31 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:52:59.975091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:59.975777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.976486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.976486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.977067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:59.977491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:59.978772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:52:59.987872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 220/446] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:52:59.991638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:52:59.992609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:52:59.992898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:52:59.993172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:52:59.993386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:52:59.993952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:52:59.994260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:52:59.995623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.004809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 227/447] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:00.012219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:00.091087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2052e2-3efb-46ad-9f55-2ac58ccf849a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.104854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851399-f75a-4d50-a6dc-6de59910bd56 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.122107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.122747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.123024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.123295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.136363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.137004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.137285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.137583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.185510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.186939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.199731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.201164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.277353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 221/448] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:53:00.282836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:00.292015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 228/449] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:53:00.297387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:00.372627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5528d49-d7de-490f-9e56-d272bfa0ff87 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.389933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f3d80-c977-46d6-b058-2074964d1acb None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.403862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.404696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.404969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.405237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] PATH_INFO: `/v3/projects/75aca24ee457414ebddf524e98cb22af` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.406417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] RBAC: Authorizing `identity:get_project(project_id=75aca24ee457414ebddf524e98cb22af)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.407824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.413920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 222/450] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:53:00 2022] GET /identity/v3/projects/75aca24ee457414ebddf524e98cb22af => generated 344 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:00.415030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:00.421177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.422051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.422327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.422596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] PATH_INFO: `/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.423739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] RBAC: Authorizing `identity:get_project(project_id=b86ce6c4c1e94d8284541207da7bf7cf)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.425143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.426820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 229/451] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:53:00 2022] GET /identity/v3/projects/b86ce6c4c1e94d8284541207da7bf7cf => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:00.432495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:00.504961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bcee3-e9ee-4718-93b9-9c458a8d067a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.522488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c78b3-e6df-4dfe-a5c2-8fd8f7de607f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.536154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.537004 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.537278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.537566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] PATH_INFO: `/v3/groups/14f11ef0879e4c8bab85f7e61eae7da3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.538712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] RBAC: Authorizing `identity:get_group(group_id=14f11ef0879e4c8bab85f7e61eae7da3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.540123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.541739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 223/452] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:53:00 2022] GET /identity/v3/groups/14f11ef0879e4c8bab85f7e61eae7da3 => generated 229 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:00.547262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:00.554567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.555407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.555688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.555963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] PATH_INFO: `/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.557120 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] RBAC: Authorizing `identity:get_group(group_id=c8d7d59fa93e470bafa81d6f5a7adf1a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.558556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.564678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 230/453] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 18:53:00 2022] GET /identity/v3/groups/c8d7d59fa93e470bafa81d6f5a7adf1a => generated 226 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:00.565614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:00.638504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af2cf-b684-491a-beb3-bf499d135164 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.656521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bb781-09f3-4ffa-bef8-1f5fe01f348d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:00.670686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7141f4-1ad5-453d-b780-c1f209bd5cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.671335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7141f4-1ad5-453d-b780-c1f209bd5cb4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.671610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7141f4-1ad5-453d-b780-c1f209bd5cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.671879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7141f4-1ad5-453d-b780-c1f209bd5cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.672722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7141f4-1ad5-453d-b780-c1f209bd5cb4 None admin] RBAC: Adding query filter params (group.id=14f11ef0879e4c8bab85f7e61eae7da3, role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=75aca24ee457414ebddf524e98cb22af) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:00.673029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7141f4-1ad5-453d-b780-c1f209bd5cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.674473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7141f4-1ad5-453d-b780-c1f209bd5cb4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.680589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 224/454] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:53:00 2022] GET /identity/v3/role_assignments?group.id=14f11ef0879e4c8bab85f7e61eae7da3&scope.project.id=75aca24ee457414ebddf524e98cb22af&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:00.689607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a572d-cbd5-48b3-8836-a2b16775989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:00.690271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a572d-cbd5-48b3-8836-a2b16775989f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:00.690547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a572d-cbd5-48b3-8836-a2b16775989f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:00.690816 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a572d-cbd5-48b3-8836-a2b16775989f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:00.691650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a572d-cbd5-48b3-8836-a2b16775989f None admin] RBAC: Adding query filter params (group.id=c8d7d59fa93e470bafa81d6f5a7adf1a, role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:00.691957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a572d-cbd5-48b3-8836-a2b16775989f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:00.693921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a572d-cbd5-48b3-8836-a2b16775989f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:00.700506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 231/455] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 18:53:00 2022] GET /identity/v3/role_assignments?group.id=c8d7d59fa93e470bafa81d6f5a7adf1a&scope.project.id=b86ce6c4c1e94d8284541207da7bf7cf&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:03.534210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11c90-d066-4349-9649-1c8d7c759309 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:03.534726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11c90-d066-4349-9649-1c8d7c759309 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:03.534836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11c90-d066-4349-9649-1c8d7c759309 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:03.536390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 225/456] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:03.542020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028609-a296-49a3-a3da-0f10639f4c72 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:03.542434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028609-a296-49a3-a3da-0f10639f4c72 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:03.542632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028609-a296-49a3-a3da-0f10639f4c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:03.570449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f0028609-a296-49a3-a3da-0f10639f4c72 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:03.571653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f0028609-a296-49a3-a3da-0f10639f4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:03.659235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 232/457] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:03.699150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb11c90-d066-4349-9649-1c8d7c759309 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:03.821800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0efd43-c747-4c8d-9448-e70dacc1109c None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:03.822149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0efd43-c747-4c8d-9448-e70dacc1109c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:03.822409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0efd43-c747-4c8d-9448-e70dacc1109c None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:03.823975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 233/458] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:03.827027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb11c90-d066-4349-9649-1c8d7c759309 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:03.833501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815dc0b-0ba1-40b6-a267-95294f83a9e2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:03.834354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815dc0b-0ba1-40b6-a267-95294f83a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:03.834631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815dc0b-0ba1-40b6-a267-95294f83a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:03.857958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b815dc0b-0ba1-40b6-a267-95294f83a9e2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:03.859150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b815dc0b-0ba1-40b6-a267-95294f83a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:03.898904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66a4de-5bbc-4d4f-91d5-42ea35e95d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:03.899707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66a4de-5bbc-4d4f-91d5-42ea35e95d62 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:03.899983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66a4de-5bbc-4d4f-91d5-42ea35e95d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:03.900251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66a4de-5bbc-4d4f-91d5-42ea35e95d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:03.918225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66a4de-5bbc-4d4f-91d5-42ea35e95d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:03.919715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66a4de-5bbc-4d4f-91d5-42ea35e95d62 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-6e66a4de-5bbc-4d4f-91d5-42ea35e95d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:03.945209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:03.946152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:03.946984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:03.946984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:03.946984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:03.946984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:03.953196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 226/459] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:03.953196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f38fc-a487-4de0-b5e9-4a059d5661e9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:03.953196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f38fc-a487-4de0-b5e9-4a059d5661e9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:03.953196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f38fc-a487-4de0-b5e9-4a059d5661e9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:03.953196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 227/460] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:03.960721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 234/461] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:03.960867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f38fc-a487-4de0-b5e9-4a059d5661e9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:03.961617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eec49b-eb19-4155-b05d-2d8fb5e24463 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:03.961906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eec49b-eb19-4155-b05d-2d8fb5e24463 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:03.962181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eec49b-eb19-4155-b05d-2d8fb5e24463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.004051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d8eec49b-eb19-4155-b05d-2d8fb5e24463 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:04.005217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d8eec49b-eb19-4155-b05d-2d8fb5e24463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:04.075347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f38fc-a487-4de0-b5e9-4a059d5661e9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.076964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 235/462] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:04.086117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eec49b-eb19-4155-b05d-2d8fb5e24463 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.114269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.116243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.116752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.117230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.118175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:04.119116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.121006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.137068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 228/463] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:04.138247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.213339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eec49b-eb19-4155-b05d-2d8fb5e24463 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.249874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.251356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.251635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.251903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.252370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfd508-57ec-48ed-9be1-ad52d30232f0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.262558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.264021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:04.282285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:04.283156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:04.283982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:04.283982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:04.283982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:04.283982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:04.283982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 236/464] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:04.284551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.290243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60d9eb-b412-4921-9749-9eaca14ffee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.291042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d9eb-b412-4921-9749-9eaca14ffee0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.291315 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d9eb-b412-4921-9749-9eaca14ffee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.291579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d9eb-b412-4921-9749-9eaca14ffee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.303674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60d9eb-b412-4921-9749-9eaca14ffee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.305395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60d9eb-b412-4921-9749-9eaca14ffee0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fc60d9eb-b412-4921-9749-9eaca14ffee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:04.322609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:04.323488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:04.324349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:04.324349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:04.324349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:04.324349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:04.324349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 229/465] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:04.325488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328483-2b3d-4950-8715-ef0ba983d6c1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.325716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328483-2b3d-4950-8715-ef0ba983d6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.325982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328483-2b3d-4950-8715-ef0ba983d6c1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.331203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 230/466] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:04.331203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328483-2b3d-4950-8715-ef0ba983d6c1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.388947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd81e7-9d1c-49f7-827f-5e9fbcf4b11c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.425173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.425691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328483-2b3d-4950-8715-ef0ba983d6c1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.426296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.426720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.427153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.428656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.430119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.451632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 237/467] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:53:04 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:04.452706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.480148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f2256-43cd-4b01-ab33-1d57b5bb6e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.481029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f2256-43cd-4b01-ab33-1d57b5bb6e2a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.481317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f2256-43cd-4b01-ab33-1d57b5bb6e2a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.481659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f2256-43cd-4b01-ab33-1d57b5bb6e2a None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.482696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f2256-43cd-4b01-ab33-1d57b5bb6e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:04.483098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f2256-43cd-4b01-ab33-1d57b5bb6e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.485043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f2256-43cd-4b01-ab33-1d57b5bb6e2a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.504023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 231/468] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:04.505775 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad08e-cea5-4d2a-9fd9-cc99cb174bc0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.506202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad08e-cea5-4d2a-9fd9-cc99cb174bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.506646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad08e-cea5-4d2a-9fd9-cc99cb174bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.529915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f97ad08e-cea5-4d2a-9fd9-cc99cb174bc0 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:04.532304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f97ad08e-cea5-4d2a-9fd9-cc99cb174bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:04.577416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937bdfd-7823-4d26-ba36-fb2e79347cad None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.606089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 232/469] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:04.607680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad08e-cea5-4d2a-9fd9-cc99cb174bc0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.630250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.630984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.631429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.631850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.632765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:04.633218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.634823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.658253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 238/470] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:04.659371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.727551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad08e-cea5-4d2a-9fd9-cc99cb174bc0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.768532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.769199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.769494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.769769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.770720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.772692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.777676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eecf38-0546-4071-8383-a051bec6a8d4 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:04.796515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 233/471] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:53:04 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:04.797997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.825440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:04.827345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:04.827912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:04.828658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:04.845434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:04.847381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:04.874410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:04.875509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:04.876564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:04.876564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:04.876564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:04.876564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:04.878974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 239/472] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:04.887510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:04.951105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5dbd8-d5f8-4c67-b751-60b73557fe2b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:05.024755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6a251-ed62-474b-9514-c51cf752541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:05.025439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a251-ed62-474b-9514-c51cf752541b None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.025748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a251-ed62-474b-9514-c51cf752541b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.026018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a251-ed62-474b-9514-c51cf752541b None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.026721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6a251-ed62-474b-9514-c51cf752541b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:05.028167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6a251-ed62-474b-9514-c51cf752541b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:05.056799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 234/473] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:53:04 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:05.058207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d17bb9-679d-4302-b715-354c3ac03741 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.058492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d17bb9-679d-4302-b715-354c3ac03741 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.058766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d17bb9-679d-4302-b715-354c3ac03741 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.060346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 235/474] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:05.066820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aee14-78fb-4ee8-8e7b-dd2115c6ecd1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.066820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aee14-78fb-4ee8-8e7b-dd2115c6ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.067109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aee14-78fb-4ee8-8e7b-dd2115c6ecd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.069823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958aaea-9e40-4813-a4d6-f2e2373590a3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:05.093229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-675aee14-78fb-4ee8-8e7b-dd2115c6ecd1 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:05.095194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-675aee14-78fb-4ee8-8e7b-dd2115c6ecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:05.116443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:05.117691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.118620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.119160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.120136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:05.120658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:05.123287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:05.141202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 240/475] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:05.148817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:05.179123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 236/476] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:53:05.207389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aee14-78fb-4ee8-8e7b-dd2115c6ecd1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:05.286807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6c8f-aee2-4b07-9a97-a22b131e0093 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:05.328022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aee14-78fb-4ee8-8e7b-dd2115c6ecd1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:05.333578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:05.335108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.335619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.336088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.337486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:05.339514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:05.369279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 241/477] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:53:05 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:05.370339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:05.371093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.371384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.371661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.372476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:05.375102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:05.383144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.sql.core [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 18:53:05.383144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 18:53:05.383144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [parameters: {'id': 'a1747b83a762404797338e89abf7de50', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 18:53:05.383144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79880) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application conn.query(q) May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result.read() May 04 18:53:05.401573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return ref.to_dict() May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:53:05.402523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application next(self.gen) May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application yield resource May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application next(self.gen) May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.session.rollback() May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.force_reraise() May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise self.value May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application session.commit() May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 18:53:05.403418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._prepare_impl() May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.session.flush() May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._flush(objects) May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application compat.raise_( May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application flush_context.execute() May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rec.execute(self) May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 18:53:05.404256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:53:05.405130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application conn.query(q) May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result.read() May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:53:05.405983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [parameters: {'id': 'a1747b83a762404797338e89abf7de50', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:05.406761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 18:53:05.407549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:05.408471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 237/478] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 18:53:05 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:05.411434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:05.525113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8145-2831-4fea-ac57-18baa672d03e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:05.561441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7172a4c-617c-4b8f-981f-fcc5915e41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:05.562672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7172a4c-617c-4b8f-981f-fcc5915e41a4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.563179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7172a4c-617c-4b8f-981f-fcc5915e41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.563652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7172a4c-617c-4b8f-981f-fcc5915e41a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.575798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7172a4c-617c-4b8f-981f-fcc5915e41a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-d7172a4c-617c-4b8f-981f-fcc5915e41a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:05.584332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:05.585669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:53:05.586485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:05.589213 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 242/479] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:05.594569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:05.699246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c769e18-2867-4351-93b7-04f7f046335c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:05.733545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1ef7-9094-4317-a8e8-a11c0a59ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:05.734588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1ef7-9094-4317-a8e8-a11c0a59ae0c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:05.735109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1ef7-9094-4317-a8e8-a11c0a59ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:05.735605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1ef7-9094-4317-a8e8-a11c0a59ae0c None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:05.736540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1ef7-9094-4317-a8e8-a11c0a59ae0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:05.737059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1ef7-9094-4317-a8e8-a11c0a59ae0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:05.738637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1ef7-9094-4317-a8e8-a11c0a59ae0c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:05.747922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 238/480] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:07.285440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acbf29-b7e6-49ad-a0c8-f764ca8af1cf None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:07.286465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acbf29-b7e6-49ad-a0c8-f764ca8af1cf None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:07.286998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acbf29-b7e6-49ad-a0c8-f764ca8af1cf None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:07.288799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 243/481] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:07.295544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e5bc-3be6-4efd-b582-8b1c29cb53eb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:07.296023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e5bc-3be6-4efd-b582-8b1c29cb53eb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:07.296111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e5bc-3be6-4efd-b582-8b1c29cb53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:07.325091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e090e5bc-3be6-4efd-b582-8b1c29cb53eb None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:07.325091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e090e5bc-3be6-4efd-b582-8b1c29cb53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:07.416620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 239/482] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:53:07.452993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acbf29-b7e6-49ad-a0c8-f764ca8af1cf None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:07.574219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acbf29-b7e6-49ad-a0c8-f764ca8af1cf None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:07.612787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9a3a-cc45-4544-8e9f-17254c75b0b2 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:07.613109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9a3a-cc45-4544-8e9f-17254c75b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:07.613349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9a3a-cc45-4544-8e9f-17254c75b0b2 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:07.617435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 240/483] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:07.621435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e63d-dc35-47e8-995b-737a7c3b9bac None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:07.621683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e63d-dc35-47e8-995b-737a7c3b9bac None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:07.621963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e63d-dc35-47e8-995b-737a7c3b9bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:07.623126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:07.623925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:07.624201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:07.624521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:07.645773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:07.654082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:07.654970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:07.655757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 244/484] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:07.665707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:07.667005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d342e63d-dc35-47e8-995b-737a7c3b9bac None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:07.668184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d342e63d-dc35-47e8-995b-737a7c3b9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:07.808141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 241/485] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:07.828845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f1148-b6cc-43af-8798-455bfdcd48bd None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:07.864724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e63d-dc35-47e8-995b-737a7c3b9bac None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:07.867610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:07.868376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:07.868553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:07.868833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:07.869618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:07.869929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:07.871317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:07.892543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 245/486] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:07.907397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:07.990042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e63d-dc35-47e8-995b-737a7c3b9bac None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.025926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.027074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.027575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.028039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.039031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:08.047156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:08.048079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:08.048881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:08.051644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 242/487] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:08.058456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.076556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ecfd7-286c-495c-a2be-bd1d16bea1b7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.114669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc77ca-b754-4bab-a8be-e74d36497fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.115448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc77ca-b754-4bab-a8be-e74d36497fc3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.115713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc77ca-b754-4bab-a8be-e74d36497fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.115986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc77ca-b754-4bab-a8be-e74d36497fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.135328 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc77ca-b754-4bab-a8be-e74d36497fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.136807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc77ca-b754-4bab-a8be-e74d36497fc3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-13dc77ca-b754-4bab-a8be-e74d36497fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:08.165190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:08.166180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:08.167105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:08.167105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:08.167105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:08.167105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:08.167105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 246/488] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:08.168793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d29fa-12bb-4400-be39-1706735ef945 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.168793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d29fa-12bb-4400-be39-1706735ef945 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.168793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d29fa-12bb-4400-be39-1706735ef945 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.170374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 247/489] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:08.175461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d29fa-12bb-4400-be39-1706735ef945 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.204316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823be5-c39f-40f7-9157-0ad5d78121bf None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.237377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7f06-8615-4201-99e8-d4fab847cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.238075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7f06-8615-4201-99e8-d4fab847cf19 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.238338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7f06-8615-4201-99e8-d4fab847cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.238609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7f06-8615-4201-99e8-d4fab847cf19 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.239343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7f06-8615-4201-99e8-d4fab847cf19 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:08.239647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7f06-8615-4201-99e8-d4fab847cf19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.241056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7f06-8615-4201-99e8-d4fab847cf19 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.249506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 243/490] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:08.250867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0aff4-6041-4ede-9836-1be1990ef951 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.251155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0aff4-6041-4ede-9836-1be1990ef951 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.251426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0aff4-6041-4ede-9836-1be1990ef951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.268210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8be0aff4-6041-4ede-9836-1be1990ef951 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:08.269381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8be0aff4-6041-4ede-9836-1be1990ef951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:08.279117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d29fa-12bb-4400-be39-1706735ef945 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.312590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.313388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.313729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.314006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.314733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:08.315129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.316492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.329792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 248/491] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:08.330786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.336440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 244/492] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:08.337282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0aff4-6041-4ede-9836-1be1990ef951 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.432301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0aff4-6041-4ede-9836-1be1990ef951 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.440509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aee0e7-7c10-40e5-a6b6-8b4c508e9bfa None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.465522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424289aa-87ef-47b2-9c93-af2fd21919f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.466318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424289aa-87ef-47b2-9c93-af2fd21919f6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.466591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424289aa-87ef-47b2-9c93-af2fd21919f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.466857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424289aa-87ef-47b2-9c93-af2fd21919f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.473651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.473815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424289aa-87ef-47b2-9c93-af2fd21919f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.474471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.474749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.475056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.475267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424289aa-87ef-47b2-9c93-af2fd21919f6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.484935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.486389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-424289aa-87ef-47b2-9c93-af2fd21919f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:08.491091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:08.491994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:08.492888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:08.493394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 245/493] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:08.494579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025dbd-e921-4049-be96-8aa8d916ace6 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.494862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025dbd-e921-4049-be96-8aa8d916ace6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.495134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025dbd-e921-4049-be96-8aa8d916ace6 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.496528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 246/494] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:08.498652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2025dbd-e921-4049-be96-8aa8d916ace6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:08.510427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:08.511298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:08.512140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:08.512140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:08.512140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:08.512140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:08.512140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 249/495] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:08.512818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.602111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2025dbd-e921-4049-be96-8aa8d916ace6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.611028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c995a-51c9-4ae4-8559-28c9a8f9ddc2 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.636258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21135364-6049-42ee-8474-e11de601d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.637044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21135364-6049-42ee-8474-e11de601d2ee None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.637322 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21135364-6049-42ee-8474-e11de601d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.637628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21135364-6049-42ee-8474-e11de601d2ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.644244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.644905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.645436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.645728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.646567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:08.646857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.648268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.649733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21135364-6049-42ee-8474-e11de601d2ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-21135364-6049-42ee-8474-e11de601d2ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:08.657507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:08.658390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:08.659173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:08.661634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 247/496] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:08.663002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505406c-da91-4646-b62b-1f2ee7ccf232 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.663445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505406c-da91-4646-b62b-1f2ee7ccf232 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.663875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505406c-da91-4646-b62b-1f2ee7ccf232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.681564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8505406c-da91-4646-b62b-1f2ee7ccf232 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:08.683087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8505406c-da91-4646-b62b-1f2ee7ccf232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:08.684970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 250/497] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:08.685821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.753323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 248/498] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:08.754188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505406c-da91-4646-b62b-1f2ee7ccf232 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.784013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abbd2a-1ae4-47ed-ac63-35266b52cd01 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.816036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.816715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.816997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.817268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.818562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:08.818866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.820238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.830855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 251/499] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:08.832534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.845583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505406c-da91-4646-b62b-1f2ee7ccf232 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.877164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05406f-5765-4e77-be9a-f92a65fe2591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.877852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05406f-5765-4e77-be9a-f92a65fe2591 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.878130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05406f-5765-4e77-be9a-f92a65fe2591 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.878426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05406f-5765-4e77-be9a-f92a65fe2591 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.879223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05406f-5765-4e77-be9a-f92a65fe2591 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:08.879527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05406f-5765-4e77-be9a-f92a65fe2591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:08.881517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05406f-5765-4e77-be9a-f92a65fe2591 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:08.889024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 249/500] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:08.890357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db118e-442a-44ca-b474-681371ce942b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.890717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db118e-442a-44ca-b474-681371ce942b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.891071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db118e-442a-44ca-b474-681371ce942b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.892517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 250/501] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:08.897186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db118e-442a-44ca-b474-681371ce942b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:08.927914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc4e9-6b78-4637-af00-9be6a8832b23 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:08.958914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:08.959974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:08.960257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:08.960582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:08.993016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db118e-442a-44ca-b474-681371ce942b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.024051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.024465 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.025248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.025550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.025645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.025826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.035362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:09.043549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:09.044412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:09.045229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 251/502] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:09.045909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.118338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 252/503] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:09.119169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.138126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de95ce-ff3b-45a6-b1c1-76746725be92 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.169416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68674f96-c704-4d03-b9eb-823088026297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.170213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68674f96-c704-4d03-b9eb-823088026297 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.170488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68674f96-c704-4d03-b9eb-823088026297 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.170761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68674f96-c704-4d03-b9eb-823088026297 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.177929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68674f96-c704-4d03-b9eb-823088026297 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.179364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68674f96-c704-4d03-b9eb-823088026297 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-68674f96-c704-4d03-b9eb-823088026297 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:09.192779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:09.194242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:09.195144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 252/504] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:09.196113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d331fa9-4212-46a3-af7e-f37eca346301 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.196113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d331fa9-4212-46a3-af7e-f37eca346301 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.196113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d331fa9-4212-46a3-af7e-f37eca346301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.212015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be682e7-6200-40fc-907c-b30fa06c2337 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.212182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0d331fa9-4212-46a3-af7e-f37eca346301 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:09.213156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0d331fa9-4212-46a3-af7e-f37eca346301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:09.243028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.243806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.244090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.244363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.253847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.255277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:09.273285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:09.274274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:09.275097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:09.275097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:09.275097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.275097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:09.275097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 253/505] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:09.275363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 253/506] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:09.275773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.276224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d331fa9-4212-46a3-af7e-f37eca346301 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.368236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d331fa9-4212-46a3-af7e-f37eca346301 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.380007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0aca6-287b-45c0-bcf3-debd40a6d68f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.400720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.401572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.401856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.402129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.411483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.411682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.412345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.412627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.412901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.412988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.413670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:09.413973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.415326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.422978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 254/507] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:09.423754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:09.430003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:09.430959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:09.431880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:09.431880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:09.431880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.431880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:09.431880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 254/508] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:09.432149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.516453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00780-2aeb-46e3-b9ba-dcfdda7ea910 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.524647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f173e-250c-4826-85ff-d253dec661fc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.547506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.548163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.548439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.548716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.549563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:09.549871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.551306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.556361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.557007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.557283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.557585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.558299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:09.558600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.559941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.567932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 255/509] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:09.569211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.575416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 255/510] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:09.576220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.660237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b78fe-b983-4abf-a5e8-332bccea763c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.667961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f67bd7-02fa-4d0e-891c-102450485cd6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.692148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.692952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.693233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.693526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.698772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.699540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.699815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.700084 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.703272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.704720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.709981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.711379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:09.721600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:09.722415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:09.723273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:09.723273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:09.723273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.723273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:09.723273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 256/511] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:09.723543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:09.728020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:09.728879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:09.729746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:09.729746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:09.729746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:09.729746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:09.729746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 256/512] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:09.730018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.820381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1316ac3-2512-49c8-9e10-5713776de406 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.820688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15006f0-d65e-429b-a91e-f5717a51744e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.851402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.851778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.852040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.852316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.852476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.852574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.852764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.853036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:09.853273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:09.853614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.854982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.866462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 257/513] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:09.867234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:09.916719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:09.918209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:09.961366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bf731-943a-47e8-bbb1-48fa28bf0daa None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:09.994715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:09.995504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:09.995780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:09.996048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.003134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.004392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.016335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 257/514] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:10.017177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:10.020057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:10.021805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:10.022697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:10.023618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 258/515] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:10.024375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.110016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ab0fc-8ecb-4f79-bb19-0a1c7bc8d2f3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.116848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6596-8492-4c9a-874e-0dd868fe2c7b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.140986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.141668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.141960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.142259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.142970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:10.143273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.144629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.148650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.149298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.149608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.149881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.150593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:10.150895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.152245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.156144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 258/516] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:10.156930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.168394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 259/517] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:10.168394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.252851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388be2a6-0933-41da-ab85-ff5b5d07bab7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.264419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae60f7-ef94-44a1-a968-1b8146adf5f3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.284789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.285602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.285904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.286176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.293169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.294633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.297677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.298457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.298734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.299003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.308503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:10.308820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:10.309802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:10.310824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:10.311485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.314916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 259/518] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:10.314916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:10.328236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:10.329110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:10.330805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:10.330805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:10.330805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:10.330805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:10.330805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 260/519] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:10.330805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.406352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4d84f-b839-4ed0-838a-7f64b3f86ebe None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.422498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13dee-529a-4cdd-b226-5540c70598e1 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.437922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.438576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.438848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.439116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.439935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:10.440238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.441668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.454328 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.454985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.455261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.455532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.456217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.457647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.476728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 261/520] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:53:10 2022] POST /identity/v3/users => generated 247 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:10.477311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.478674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 260/521] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:10.479516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.580311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a094b-6e0c-441b-8b0b-f73c802a5e47 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.597050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6aab-3954-4e3c-bf79-f8748ce4814b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.624732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.625575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.625902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.626200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.635146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.636808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.647089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.647765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.648066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.648339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.649137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:10.649449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.650939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:10.652812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:10.653933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:53:10.654840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:10.658884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 262/522] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:10.659545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.670124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 261/523] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:10.670978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.769479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e3de-1583-4782-a34e-088bc62c2dfd None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.773033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56529-8de6-474e-83de-2c4c49152e45 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.805044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.805734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.806018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.806116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.806286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.806699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.806977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.807069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:10.807243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.807344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.808641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.825239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 263/524] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:10.825239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.877078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.878572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.919758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f3f43-2f7a-4779-8ede-ef1d522ef9cb None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:10.954322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:10.955217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.955663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.956074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:10.957042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:10.957519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:10.959055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:10.981930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 264/525] 10.222.0.69 () {56 vars in 1139 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:10.981930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:10.989031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 262/526] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:10.995263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.084526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08a666-9570-4599-8be9-cd477c6acd15 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.086614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cde972-b95d-4359-8cf8-a7937c784e4b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.118161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.118802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.119081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.119350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.120160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=ea420049f83643a19cb6c1d0a36fc8bc) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:11.120465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.120690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.121553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.121835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.121928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.122105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.137723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 265/527] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/role_assignments?user.id=ea420049f83643a19cb6c1d0a36fc8bc&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:11.137723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.139471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.141793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:11.162481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:11.163579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:11.164644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:11.168814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 263/528] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:11.170812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.243910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b063-e003-44d4-a16a-e6f678d6c26f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.279913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.280707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.281062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.281259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31061f-2ea7-4b19-8fe9-fdda6b126c8e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.281477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.327140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.327966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.328245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.328519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.340174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.341672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.356939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.358516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:11.359762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:11.362028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:11.364112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:11.364112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:11.364112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:11.364112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:11.364112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 264/529] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:11.373527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.456994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 266/530] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:11.457799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.470510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fc279-1ecd-4cab-b99c-38c68a8aa729 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.504893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.505622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.505903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.506178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.506969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:11.507284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.508730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.527581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 265/531] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:11.528525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.555863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eae66-882a-4e4d-b8ae-0c260efb2c91 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.589244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.590213 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.590520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.591179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:11.591479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.592834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.605199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 267/532] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:11.606098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.635402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37fae8-96a0-4649-a5a4-5b914ccfdcd1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.673665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.674460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.674742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.675017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.686044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.687527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:11.706402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:11.709041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:11.711178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:11.711178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:11.711178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:11.711178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:11.716309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 266/533] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:11.716309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.716675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35eed3-d495-44b6-9ec7-d612acb00d75 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.749833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.750479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.750792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.751071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.751938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=eb9c380955a04c24af2823e22fe3ec70) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:11.752247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.753711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.759239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 268/534] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/role_assignments?user.id=eb9c380955a04c24af2823e22fe3ec70&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:11.760090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.887497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ecbc5-cd2b-4bc4-ba38-8860e1ac1603 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.924009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2585c-c862-4e80-86c6-c3b8b2941325 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.968848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.968848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.968848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.968848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.974499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:11.974499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.974499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.975559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.975559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.975559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.975559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.983048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 269/535] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:11.983643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.985104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.991590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:12.009051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:12.009986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:12.010851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 267/536] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:12.021801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:12.099716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1881d43-e446-4e9b-9946-e78b138df646 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:12.133585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:12.134640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:12.135058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:12.135465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:12.150423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:12.153751 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:12.173135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:12.174222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:12.175116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:12.187595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 270/537] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:12.193215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfd9ff-01eb-48c3-8d04-062d9579ea26 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:12.194335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:12.269242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:12.270428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:12.270829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:12.273919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:12.274855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:12.275308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:12.278495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:12.304791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 268/538] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:12.311688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:12.356248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f495-c9ff-45f7-8c8e-a27d5574cd9f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:12.402158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:12.402885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:12.403101 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:12.403376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:12.404165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:12.404491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:12.405914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:12.440028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 271/539] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:12.445953 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:12.448862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a87a2e-31d0-417e-a345-6dfbbd0a14f8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:12.482317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fca2ce-73bf-4b59-9001-a04670adf5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:12.483742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca2ce-73bf-4b59-9001-a04670adf5c1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:12.484214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca2ce-73bf-4b59-9001-a04670adf5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:12.484677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca2ce-73bf-4b59-9001-a04670adf5c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:12.485710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca2ce-73bf-4b59-9001-a04670adf5c1 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=e39540c05b40402786e682d974ee6018) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:12.486214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca2ce-73bf-4b59-9001-a04670adf5c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:12.487868 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca2ce-73bf-4b59-9001-a04670adf5c1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:12.494354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 269/540] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:12 2022] GET /identity/v3/role_assignments?user.id=e39540c05b40402786e682d974ee6018&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:12.579237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e915-2ef6-4382-ac0f-b42620267e6c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:12.617857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d8847-68df-45ba-bd5a-cb7c21fd3118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:12.618892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d8847-68df-45ba-bd5a-cb7c21fd3118 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:12.619396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d8847-68df-45ba-bd5a-cb7c21fd3118 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:12.619863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d8847-68df-45ba-bd5a-cb7c21fd3118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:12.620897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d8847-68df-45ba-bd5a-cb7c21fd3118 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=39f773f90b8c47608040ee24866242f2) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:12.621435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d8847-68df-45ba-bd5a-cb7c21fd3118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:12.623126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d8847-68df-45ba-bd5a-cb7c21fd3118 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:12.630100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 272/541] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:12 2022] GET /identity/v3/role_assignments?user.id=39f773f90b8c47608040ee24866242f2&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:13.022879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153397c-ccdf-4a98-bc58-6cd604361d57 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.023199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153397c-ccdf-4a98-bc58-6cd604361d57 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.023429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153397c-ccdf-4a98-bc58-6cd604361d57 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.025030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 270/542] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:13.030371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980ae2d-31b4-4af4-bc79-aecd6a3cb976 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.030659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980ae2d-31b4-4af4-bc79-aecd6a3cb976 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.030939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980ae2d-31b4-4af4-bc79-aecd6a3cb976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.054703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1980ae2d-31b4-4af4-bc79-aecd6a3cb976 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:13.055871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1980ae2d-31b4-4af4-bc79-aecd6a3cb976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:13.121730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 273/543] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:13.145062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153397c-ccdf-4a98-bc58-6cd604361d57 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:13.246574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153397c-ccdf-4a98-bc58-6cd604361d57 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:13.281891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:13.282709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.282985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.283255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.294308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:13.302620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:13.303919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:13.305016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 271/544] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:13.311982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980ae2d-31b4-4af4-bc79-aecd6a3cb976 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:13.424034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980ae2d-31b4-4af4-bc79-aecd6a3cb976 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:13.463392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257fae4-da80-4b15-a7ab-b7c47e2e23af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:13.464428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257fae4-da80-4b15-a7ab-b7c47e2e23af None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.464902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257fae4-da80-4b15-a7ab-b7c47e2e23af None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.465365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257fae4-da80-4b15-a7ab-b7c47e2e23af None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.466340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257fae4-da80-4b15-a7ab-b7c47e2e23af None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:13.466837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257fae4-da80-4b15-a7ab-b7c47e2e23af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:13.468410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257fae4-da80-4b15-a7ab-b7c47e2e23af None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:13.477145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 274/545] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:13.482992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:13.600547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784f1-2781-4863-a4f5-b00fa82083b0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:13.615874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7030-36b7-42d4-8614-3349dbbe9848 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.616410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7030-36b7-42d4-8614-3349dbbe9848 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.616410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7030-36b7-42d4-8614-3349dbbe9848 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.618030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 275/546] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:13.623387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93674d62-5e1f-4ba0-90e6-0d9544eaff2c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.623627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93674d62-5e1f-4ba0-90e6-0d9544eaff2c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.623896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93674d62-5e1f-4ba0-90e6-0d9544eaff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.640383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-93674d62-5e1f-4ba0-90e6-0d9544eaff2c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:13.640561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:13.641353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.641652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-93674d62-5e1f-4ba0-90e6-0d9544eaff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:13.641773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.641952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.659010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:13.660805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:13.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:13.693591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:13.694425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:13.694425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:13.694425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:13.694425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:13.696202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 272/547] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:13.706430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:13.724656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 276/548] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:53:13.748089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93674d62-5e1f-4ba0-90e6-0d9544eaff2c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:13.850031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033cfe-ae97-4cee-baac-2d735f4864d1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:13.856705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93674d62-5e1f-4ba0-90e6-0d9544eaff2c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:13.890613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:13.891410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.891692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.891964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.903202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:13.911058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:13.912531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:13.913792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 277/549] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:13.918968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:13.943280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:13.944340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:13.944340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:13.944340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:13.946634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:13.946634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:13.954791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.000015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 273/550] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:14.005721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:14.021670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9c7a-2dfb-4cb8-8f2f-394c3fbcf571 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.094238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.094921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.095207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.095484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.096242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:14.096550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.101647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.114083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 278/551] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:14.119619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:14.168492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08df9-e45f-443f-a570-5dd2d7090666 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.202442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.203236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.203522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.203796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.218699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.220149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:14.240965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:14.241939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:14.242831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 274/552] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:14.255948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:14.316488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79050-1256-41f9-9a69-34537a42eb42 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.371461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.372344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.372630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.372900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.385318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.386956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:14.406314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:14.407176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:14.408015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:14.408015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:14.408015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:14.408015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:14.412616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 279/553] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:14.414047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:14.475739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f8a4-cc83-4d56-9894-b412dd4d97b5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.525995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4ed5-6256-4396-9f83-10d5e55ec44e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.562513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.563175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.563448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.563720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.564489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:14.564792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.566234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.571610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.572297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.572581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.572857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.573723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:14.574033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.575469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.585411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 280/554] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:14.586650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:14.610543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 275/555] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:14.631466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:14.696705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16223d2c-3e3a-45de-b85c-9cda10bfdb6f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.730741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9a11c-8e78-487a-b01a-c48dfe3df394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.731526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a11c-8e78-487a-b01a-c48dfe3df394 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.731803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a11c-8e78-487a-b01a-c48dfe3df394 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.732130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a11c-8e78-487a-b01a-c48dfe3df394 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.740094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9a11c-8e78-487a-b01a-c48dfe3df394 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.741541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9a11c-8e78-487a-b01a-c48dfe3df394 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.750672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470259f-d43a-4f6e-9fb6-ed9cccd95ad3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-1be9a11c-8e78-487a-b01a-c48dfe3df394 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:14.756364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:14.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:14.760709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:14.765493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 281/556] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:14.765493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a4ca-697a-4979-aada-3dfa8bbfdb8a None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.765493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a4ca-697a-4979-aada-3dfa8bbfdb8a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.765493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a4ca-697a-4979-aada-3dfa8bbfdb8a None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.766033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 282/557] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:14.770580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a4ca-697a-4979-aada-3dfa8bbfdb8a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:14.790606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.791255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.791533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.791805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.858765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.860252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.874043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a4ca-697a-4979-aada-3dfa8bbfdb8a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:14.908702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff74ad-9d12-4e8e-a12e-a4bd43b90f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:14.909289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff74ad-9d12-4e8e-a12e-a4bd43b90f1a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.909595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff74ad-9d12-4e8e-a12e-a4bd43b90f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.909862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff74ad-9d12-4e8e-a12e-a4bd43b90f1a None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.910747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff74ad-9d12-4e8e-a12e-a4bd43b90f1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:14.911049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff74ad-9d12-4e8e-a12e-a4bd43b90f1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:14.913043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff74ad-9d12-4e8e-a12e-a4bd43b90f1a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:14.935828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 283/558] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:14.937364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955b17e-a63f-412a-8377-26d1ce5337ec None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:14.937747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955b17e-a63f-412a-8377-26d1ce5337ec None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:14.938023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955b17e-a63f-412a-8377-26d1ce5337ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:14.954494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a955b17e-a63f-412a-8377-26d1ce5337ec None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:14.955672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a955b17e-a63f-412a-8377-26d1ce5337ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:14.960474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 276/559] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:53:14.961345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.033632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 284/560] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:15.034676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955b17e-a63f-412a-8377-26d1ce5337ec None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.064409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b1da-4b0a-4c48-94d1-4ea0ddd7475d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.100397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.101191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.101495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.101779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.112007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.113447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:15.131534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:15.133637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:15.135810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:15.135810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:15.135810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:15.135810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:15.135810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 277/561] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:15.135810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.163633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955b17e-a63f-412a-8377-26d1ce5337ec None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.197372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.198211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.198485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.198752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.209272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.210765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:15.228823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:15.230755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:15.232327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:15.232327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:15.232327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:15.232327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:15.232676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678dac-09da-4e96-b5c3-aba9dadd8f78 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.237496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 285/562] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:15.237496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.266530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1fcd7-bb02-4c01-812c-522f747396c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.267311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fcd7-bb02-4c01-812c-522f747396c9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.267579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fcd7-bb02-4c01-812c-522f747396c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.267861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fcd7-bb02-4c01-812c-522f747396c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.278521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1fcd7-bb02-4c01-812c-522f747396c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8de1fcd7-bb02-4c01-812c-522f747396c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:15.285849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:15.287348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 278/563] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:15.293164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50060fe-1b14-4ef1-8bea-5db580cfa2ae None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.293962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50060fe-1b14-4ef1-8bea-5db580cfa2ae None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.293962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50060fe-1b14-4ef1-8bea-5db580cfa2ae None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.293962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 279/564] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:15.293962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50060fe-1b14-4ef1-8bea-5db580cfa2ae None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.347832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b129db-c403-4175-b38b-f99d47b2d730 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.381138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7bbdf-0341-4df8-9a79-66f476fbae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.381826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7bbdf-0341-4df8-9a79-66f476fbae89 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.382100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7bbdf-0341-4df8-9a79-66f476fbae89 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.382371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7bbdf-0341-4df8-9a79-66f476fbae89 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.383083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7bbdf-0341-4df8-9a79-66f476fbae89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:15.383384 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7bbdf-0341-4df8-9a79-66f476fbae89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.384731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7bbdf-0341-4df8-9a79-66f476fbae89 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.396968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 286/565] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:15.398291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5d9cd-02ca-4176-aa75-f371029875a1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.398576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5d9cd-02ca-4176-aa75-f371029875a1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.398845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5d9cd-02ca-4176-aa75-f371029875a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.405652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50060fe-1b14-4ef1-8bea-5db580cfa2ae None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.415233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c5e5d9cd-02ca-4176-aa75-f371029875a1 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:15.416326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c5e5d9cd-02ca-4176-aa75-f371029875a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:15.445883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.446948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.447407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.448035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.449775 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:15.450268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.451855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.468572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 280/566] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:15.469384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.489484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 287/567] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:15.489484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5d9cd-02ca-4176-aa75-f371029875a1 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.572438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5d9cd-02ca-4176-aa75-f371029875a1 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.575253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a538d23-6698-4558-a9e5-a96cae9201c0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.604620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.605401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.605703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.605975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.608983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.609660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.609935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.610204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.610932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:15.611233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.612416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.612580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.613845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.620316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 281/568] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:15.621081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:15.626997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:15.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 288/569] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:15.628951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.714617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37772-92cd-4487-9083-283e944c4b21 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.729676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee7b5-dbed-4bd9-8aeb-65a9475e0d17 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.745749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6fea4-17b2-4200-bea5-4d2b902d547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.746534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6fea4-17b2-4200-bea5-4d2b902d547e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.746811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6fea4-17b2-4200-bea5-4d2b902d547e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.747082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6fea4-17b2-4200-bea5-4d2b902d547e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.753379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6fea4-17b2-4200-bea5-4d2b902d547e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.754838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6fea4-17b2-4200-bea5-4d2b902d547e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.761005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.761804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.762081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.762350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7db6fea4-17b2-4200-bea5-4d2b902d547e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:15.768938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:15.769907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:15.772035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 282/570] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:15.772535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7b96-c1c8-41cf-824b-551d7fb2784a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.772535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7b96-c1c8-41cf-824b-551d7fb2784a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.772702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7b96-c1c8-41cf-824b-551d7fb2784a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.773986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 283/571] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:15.774680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7b96-c1c8-41cf-824b-551d7fb2784a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.776585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:15.784716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:15.785821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:15.786644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 289/572] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:15.787334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.868801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7b96-c1c8-41cf-824b-551d7fb2784a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.879528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327bad-f7ee-4cfc-9d48-bccad23ab6b5 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:15.900871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdb8db-54a9-471e-8bdb-46d899fede9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.901674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb8db-54a9-471e-8bdb-46d899fede9d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.901956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb8db-54a9-471e-8bdb-46d899fede9d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.902229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb8db-54a9-471e-8bdb-46d899fede9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.911961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdb8db-54a9-471e-8bdb-46d899fede9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.912100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:15.912684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.912958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.913223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.913390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdb8db-54a9-471e-8bdb-46d899fede9d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.914016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:15.914313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:15.915703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:15.927045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 290/573] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:15.927827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-62bdb8db-54a9-471e-8bdb-46d899fede9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:15.930202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:15.931059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:15.931941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:15.931941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:15.931941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:15.931941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:15.936626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 284/574] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:15.936626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945586c-6191-44fd-a72e-86b8b000c864 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:15.936626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945586c-6191-44fd-a72e-86b8b000c864 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:15.936626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945586c-6191-44fd-a72e-86b8b000c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:15.951756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7945586c-6191-44fd-a72e-86b8b000c864 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:15.952917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7945586c-6191-44fd-a72e-86b8b000c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:16.015054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 285/575] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:16.015878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945586c-6191-44fd-a72e-86b8b000c864 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.035944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171017b-f835-4339-85c9-7c9b90de7117 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.068701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.069348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.069659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.069930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.070699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:16.071006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.072435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.083268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 291/576] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:16.084022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.109776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945586c-6191-44fd-a72e-86b8b000c864 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.141338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.142035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.142309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.142734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.143466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:16.143761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.145370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.152789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 286/577] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:16.153585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.175135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577f1f1-81a5-4b3b-aaf1-ccfd24c02b4d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.207374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.208274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.208554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.208829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/ea420049f83643a19cb6c1d0a36fc8bc/roles/2a60ba556fb14d54b12b57808444fca0` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.222377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=ea420049f83643a19cb6c1d0a36fc8bc, role_id=2a60ba556fb14d54b12b57808444fca0)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.223816 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.235802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 292/578] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:16 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/ea420049f83643a19cb6c1d0a36fc8bc/roles/2a60ba556fb14d54b12b57808444fca0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:16.236641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.246898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d62a4-2c95-46f9-afb7-13102b969aff None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.287798 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.288474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.288754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.289019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.289783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:16.290088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.291591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.309662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 287/579] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:16.309662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.351276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2783a-20b1-42ef-b17d-a11c2b86133a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.387901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.388881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.389163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.389431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.400583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:16.408485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:16.409636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:16.410462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 293/580] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:16.411158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.415725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6c25-b908-4849-b933-9c3b9a8a551d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.456900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.457597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.457874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.458171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.458989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=0e9763d8a5c040ce876a787bed7fc954) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:16.459301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.460693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.466208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 288/581] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/role_assignments?user.id=0e9763d8a5c040ce876a787bed7fc954&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:16.466870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.524607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a0f13-fa0f-43c6-997c-46adcbe29f13 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.562253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.563518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.564011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.564514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.575323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea290876-6265-4443-bf2f-5a2479d8025d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.578057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.579808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:16.598283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:16.599798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:16.600722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:16.600722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:16.600722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:16.600722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:16.603122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 294/582] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:16.604279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.613940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.615600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.615718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.615981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.624406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.625930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:16.641635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:16.642645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:16.643586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 289/583] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:16.644770 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.712543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dfe14-8511-40a5-9795-cfa53bd4b156 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.743377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baaca4-a7d8-4154-a53b-597b69d7b239 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.751130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.751801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.752084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.752358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.753101 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:16.753405 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.754804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.763060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 295/584] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:16.763867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.778184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.778766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.779039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.779308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.780020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:16.780317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.781685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.799030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 290/585] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:16.799918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.867355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208feb5-9407-4154-9ec6-49b7d901f033 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.897291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2acb18-270f-4a25-b47e-f31d9f8a27a7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:16.901075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.901784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.902065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.902343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.903179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:16.903489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.904906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.925029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 296/586] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:16.925994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:16.931155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:16.931938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:16.932211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:16.932479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:16.943424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:16.944863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:16.962317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:16.964458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:16.966743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:16.966743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:16.966743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:16.966743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:16.966743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 291/587] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:16.966743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.027610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f14e7-a4e8-4c2d-b5a3-946aa857be79 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.061569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b9fb-0e38-4b60-9064-b495ce544eea None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.061985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.062780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.063059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.063357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.070717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.072149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:17.087175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:17.088446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:17.089374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 297/588] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:17.090002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.102449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.103492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.103905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.104269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.115321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.116900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:17.133783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:17.134853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:17.135955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:17.135955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:17.135955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:17.135955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:17.138169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 292/589] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:17.138578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.191844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b75b9-40a5-4ac2-ba41-a45baa779f71 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.226499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.227164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.227443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.227712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.228424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:17.228728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.230111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.241851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 298/590] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:17.242118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f82d8-6998-495d-9993-86a247b8ebcc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.242672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.276988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.277682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.277968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.278314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.279152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:17.279454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.280873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.298852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 293/591] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:17.299847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.344125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3912a0-679f-4795-a428-00da45347365 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.376981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.377678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.378007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.378286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.379007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:17.379313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.381256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.398237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 299/592] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:17.398237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.413176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17fc9-4926-445d-8ec3-6c887862c583 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.448126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.449291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.449786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.450255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.458205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.460398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:17.475207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:17.476167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:53:17.477075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:17.479268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 294/593] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:17.480340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.495059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643e21-a790-4280-9663-a0aaef5186ce None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.530818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.531611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.531886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.532154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.542341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.543787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:17.561442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:17.562338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:17.563633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:17.563633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:17.563633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:17.563633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:17.563633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 300/594] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:17.563917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.592703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c614f-d2f3-4001-a15e-62387c6e3827 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.626774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.627494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.627767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.628036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.635506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.637059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:17.651036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:17.653098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 295/595] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:17.655202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.663710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a716e-ff05-4d55-833d-a1fd1266b854 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.699541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.700213 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.700492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.700766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.701805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:17.702120 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.703545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.721399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 301/596] 10.222.0.69 () {56 vars in 1139 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:17.722268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.754680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b74c16-1083-4de4-9a4e-f34d23e9cbbf None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.788038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.788751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.789027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.789299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.790087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:17.790389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.791739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.804380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 296/597] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:17.805214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.823575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a16e-b550-4d43-a925-6702566b52be None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.860505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.861441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.861749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.862023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.863324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:17.863689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.866100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.882368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 302/598] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:17.883204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:17.906290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f8f2c-0f42-4fb6-a16e-0039e48128a3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:17.940887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:17.941877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:17.942249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:17.942658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:17.952626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:17.954213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:17.971521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:17.973020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:17.975497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:17.975497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:17.975497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:17.975497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:17.975497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 297/599] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:17.978283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:18.011886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c848f-3c41-40fe-928b-48cb98c8a115 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.045708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.046592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.046963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.047300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.054789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.056848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:18.076258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:18.078179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:18.080178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 303/600] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:18.081357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:18.090074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275067-c325-4706-914e-89395e0c8dba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.132676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.133670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.133954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.134553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/eb9c380955a04c24af2823e22fe3ec70/roles/2a60ba556fb14d54b12b57808444fca0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.153089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=eb9c380955a04c24af2823e22fe3ec70, role_id=2a60ba556fb14d54b12b57808444fca0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.154910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.173698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 298/601] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:17 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/eb9c380955a04c24af2823e22fe3ec70/roles/2a60ba556fb14d54b12b57808444fca0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:18.174580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:18.190296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c2444-aa85-431a-b325-d2c6b7a23f7b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.241149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.241923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.242206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.243399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.244145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:18.244453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.245879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.272132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 304/602] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:18.275565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:18.351733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c4e27-a560-48e4-9c8a-b97d22d0a8d8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.414838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a1b9-2e62-4c3c-9420-b180ed172da3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.448962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.449670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.449942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.450207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.450984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:18.451291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.452723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.456591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.457700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.458718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.459190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.467577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.468074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 299/603] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:18.469686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.474410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:18.485268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:18.486227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:18.487102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:18.489647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 305/604] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:18.495187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:18.631871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e399-4de3-4e8f-a8c9-e5c466045faa None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.652268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512926-b781-463a-9741-85e3e8622bc1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.675183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.675779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.676057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.676326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.677186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:18.677513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.678987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.702309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 306/605] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:18.707865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:18.722100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b12a-cc62-4bba-b13e-b4b5e8b7b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.722993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b12a-cc62-4bba-b13e-b4b5e8b7b5c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.723265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b12a-cc62-4bba-b13e-b4b5e8b7b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.723534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b12a-cc62-4bba-b13e-b4b5e8b7b5c7 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/e39540c05b40402786e682d974ee6018/roles/2a60ba556fb14d54b12b57808444fca0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.749251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33b12a-cc62-4bba-b13e-b4b5e8b7b5c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=e39540c05b40402786e682d974ee6018, role_id=2a60ba556fb14d54b12b57808444fca0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.750732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33b12a-cc62-4bba-b13e-b4b5e8b7b5c7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.769555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 300/606] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:18 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/e39540c05b40402786e682d974ee6018/roles/2a60ba556fb14d54b12b57808444fca0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:53:18.772065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139664-f301-4bd1-a44f-8e8bb6720ae5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.772408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139664-f301-4bd1-a44f-8e8bb6720ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.772680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139664-f301-4bd1-a44f-8e8bb6720ae5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.776017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 301/607] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:18.790802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdabced-c9c1-4c4b-9eeb-8a7b13cac21c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.791131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdabced-c9c1-4c4b-9eeb-8a7b13cac21c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.791349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdabced-c9c1-4c4b-9eeb-8a7b13cac21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.819141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2fdabced-c9c1-4c4b-9eeb-8a7b13cac21c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:18.821271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2fdabced-c9c1-4c4b-9eeb-8a7b13cac21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:18.861097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907c1e-17d5-4784-a508-e6bc0b73d8c7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:18.910923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:18.912017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.912299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.912567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/39f773f90b8c47608040ee24866242f2/roles/2a60ba556fb14d54b12b57808444fca0` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.915017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 302/608] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:53:18.916447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87335-7848-484c-bf78-9c3a7c5ff03a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.916738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87335-7848-484c-bf78-9c3a7c5ff03a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.917016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87335-7848-484c-bf78-9c3a7c5ff03a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.922777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 303/609] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:18.929671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e35b5-4b3d-40c4-ae87-6e712b6f5503 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:18.929940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e35b5-4b3d-40c4-ae87-6e712b6f5503 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:18.930144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e35b5-4b3d-40c4-ae87-6e712b6f5503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:18.946686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=39f773f90b8c47608040ee24866242f2, role_id=2a60ba556fb14d54b12b57808444fca0)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:18.948141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:18.954753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b18e35b5-4b3d-40c4-ae87-6e712b6f5503 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:18.956359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b18e35b5-4b3d-40c4-ae87-6e712b6f5503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:18.968179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 307/610] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:18 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/39f773f90b8c47608040ee24866242f2/roles/2a60ba556fb14d54b12b57808444fca0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:18.974913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.033310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 304/611] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:19.059766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e35b5-4b3d-40c4-ae87-6e712b6f5503 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.125722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848a34-7190-47bb-93e0-58ee6798aa72 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:19.166553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:19.167366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:19.167643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:19.167967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:19.181208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:19.190090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:19.191074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:19.191923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:19.197784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 308/612] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:19.199217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.251452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e35b5-4b3d-40c4-ae87-6e712b6f5503 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:19.304129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:19.304932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:19.305207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:19.305489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:19.319769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:19.327487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:19.328417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:19.329251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 305/613] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:19.337227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.344183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7fa79-55ca-4719-925f-ed77e6eae54e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:19.404974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:19.405664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:19.405946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:19.406219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:19.406964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:19.407268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:19.408632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:19.421771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 309/614] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:19.429425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.488189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d960bd-980b-427a-98c1-f554db068448 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:19.547509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:19.548171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:19.548445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:19.548712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:19.549449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:19.550551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:19.552543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:19.569581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 306/615] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:19.574966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.609184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb154bb-3026-4065-a3e0-3a9d78b4d1c9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:19.648693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:19.650339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:19.650803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:19.651255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:19.663821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:19.665762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:19.685743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:19.686650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:19.687530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:19.687530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:19.687530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:19.687530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:19.690236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 310/616] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:19.696247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.753149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac2f3-a9e0-4c2f-a1a3-59d3a9f95a9c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:19.817772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:19.818558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:19.818832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:19.819096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:19.841844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:19.843623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:19.862608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:19.863561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:19.864499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:19.864499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:19.864499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:19.864499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:19.864733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7f507-8270-4472-b00e-100b6161dc36 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:19.868422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 307/617] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:19.869637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:19.904462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:19.905132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:19.905415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:19.905765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:19.906495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:19.906851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:19.908432 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:19.922556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 311/618] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:19.928216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.035688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7d086-d950-4516-9be5-5e34171092d4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.071048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d47de0-3a49-4d5d-a121-dfb803b19427 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.096306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.096977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.097252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.097554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.098295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:20.098597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.102045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.119600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 308/619] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:20.124182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.139474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.140264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.140539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.140807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.152432 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.153890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:20.173307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:20.174308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:20.175243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:20.175768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 312/620] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:53:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:20.182396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.257120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831e43-9da9-47b0-85c9-a48a6a3a7943 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.291539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.292622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.293100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.293583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.301089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.302872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:20.323806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:20.324799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:20.325793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:20.328483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 309/621] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:20.338468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.343883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f334b-5304-468f-99dd-5a3ffd7adde6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.377653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.378779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.379333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.381245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.382321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:20.383049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.385173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.404015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 313/622] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:20.409613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.457296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d995a-794d-4079-bc74-07db8f134563 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.491872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.492870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.493343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.493925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.494948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:20.495449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.497070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.515640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 310/623] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:20.522403 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.573167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89979-5101-495d-b27f-cb8da7020c40 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.630877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4dce5-3b49-443e-9d91-6375b7652324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.631355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4dce5-3b49-443e-9d91-6375b7652324 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.631635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4dce5-3b49-443e-9d91-6375b7652324 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.631905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4dce5-3b49-443e-9d91-6375b7652324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.640096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53884a1-0bb6-4b34-a50a-3185edf371aa None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.695356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.696570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.697070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.697607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.708910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.710747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.719742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4dce5-3b49-443e-9d91-6375b7652324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.721123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4dce5-3b49-443e-9d91-6375b7652324 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:20.729221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:20.730192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:20.731118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:20.731118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:20.731118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:20.731118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:20.733333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 311/624] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:20.738551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.841565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc02d2-2abd-4d0b-bfb4-e75851ade8e3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:20.876671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a636-0344-4376-bbbd-2d4fbd8f6288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:20.877837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a636-0344-4376-bbbd-2d4fbd8f6288 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.878323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a636-0344-4376-bbbd-2d4fbd8f6288 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.878810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a636-0344-4376-bbbd-2d4fbd8f6288 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.879639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 314/625] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:20.880889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a636-0344-4376-bbbd-2d4fbd8f6288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:20.881402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a636-0344-4376-bbbd-2d4fbd8f6288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:20.881633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f296c0-0f35-4a76-b225-28fb2dda7a9e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.881921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f296c0-0f35-4a76-b225-28fb2dda7a9e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.882194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f296c0-0f35-4a76-b225-28fb2dda7a9e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.883646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a636-0344-4376-bbbd-2d4fbd8f6288 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:20.887514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 315/626] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:20.888294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f296c0-0f35-4a76-b225-28fb2dda7a9e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:20.897436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 312/627] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:20.899095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e5fab-68b7-4c46-8f68-1cc753afaf72 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:20.899595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e5fab-68b7-4c46-8f68-1cc753afaf72 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:20.900080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e5fab-68b7-4c46-8f68-1cc753afaf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:20.917446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2d6e5fab-68b7-4c46-8f68-1cc753afaf72 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:20.919003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2d6e5fab-68b7-4c46-8f68-1cc753afaf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:20.988231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 313/628] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:20.989937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e5fab-68b7-4c46-8f68-1cc753afaf72 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.010134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f296c0-0f35-4a76-b225-28fb2dda7a9e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.060708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.062833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.063355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.063847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.079660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.082080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.093699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e5fab-68b7-4c46-8f68-1cc753afaf72 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:21.105401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:21.106348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:21.107230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:21.107230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:21.107230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:21.107230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:21.109864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 316/629] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:21.111449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.133720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.134617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.134896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.135166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.143738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.145933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:21.162421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:21.163341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:21.164365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 314/630] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:21.164877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.240180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa69d6-fbc4-41d7-ad95-744d245d2b16 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.282922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.284210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.284719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.285128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac57e4-fd5f-49f2-9df5-5ee4889c4602 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.285434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.299941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:21.310535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:21.311541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:21.312412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 317/631] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:21.313157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.329014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.329701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.329980 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.330252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.330974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:21.331276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.333592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.352002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 315/632] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:21.352002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.437857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ad243-fab8-4324-ba4e-1e67b436ec1a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.460286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d638-e9d8-41e0-9121-a8d7fe9434dc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.470148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.470799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.471072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.471347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.472116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:21.472421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.474512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.490880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 318/633] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:21.490880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.498218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fd402-e861-45a8-a528-22e8a74c5766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.498892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fd402-e861-45a8-a528-22e8a74c5766 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.499175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fd402-e861-45a8-a528-22e8a74c5766 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.499447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fd402-e861-45a8-a528-22e8a74c5766 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.500187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fd402-e861-45a8-a528-22e8a74c5766 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:21.500493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fd402-e861-45a8-a528-22e8a74c5766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.501891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fd402-e861-45a8-a528-22e8a74c5766 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.514162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 316/634] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:21.514162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c0fd-7e82-4d26-b4b6-f82100360d75 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.514162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c0fd-7e82-4d26-b4b6-f82100360d75 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.514162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c0fd-7e82-4d26-b4b6-f82100360d75 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.514162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 317/635] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:21.514162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c0fd-7e82-4d26-b4b6-f82100360d75 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.588931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64053cd-9bdf-47d4-92a1-bd6765750728 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.615787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c0fd-7e82-4d26-b4b6-f82100360d75 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.630706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.632048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.632574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.633067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.642565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.644538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.647667 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1071d1-9ee4-496c-86e1-61fb128b07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.648556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1071d1-9ee4-496c-86e1-61fb128b07ab None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.648832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1071d1-9ee4-496c-86e1-61fb128b07ab None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.649099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1071d1-9ee4-496c-86e1-61fb128b07ab None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/0e9763d8a5c040ce876a787bed7fc954/roles/2a60ba556fb14d54b12b57808444fca0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:21.660624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:21.662352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:21.663287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 319/636] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:21.664660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.669610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1071d1-9ee4-496c-86e1-61fb128b07ab None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=0e9763d8a5c040ce876a787bed7fc954, role_id=2a60ba556fb14d54b12b57808444fca0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.671043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1071d1-9ee4-496c-86e1-61fb128b07ab None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.687999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 318/637] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:21 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/0e9763d8a5c040ce876a787bed7fc954/roles/2a60ba556fb14d54b12b57808444fca0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:21.690027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50196-fa9b-42f8-815b-00eb82c22a52 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.690430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50196-fa9b-42f8-815b-00eb82c22a52 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.691063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50196-fa9b-42f8-815b-00eb82c22a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.714968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6ae50196-fa9b-42f8-815b-00eb82c22a52 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:21.716416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6ae50196-fa9b-42f8-815b-00eb82c22a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:21.798575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7a8a-1ec8-4d1d-805b-baf58f11951b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.810237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 319/638] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:21.811484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae50196-fa9b-42f8-815b-00eb82c22a52 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.840877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.841767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.842149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.842560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.853980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.855639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:21.873938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:21.874932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:21.876055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:21.876055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:21.876055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:21.876055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:21.876055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 320/639] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:21.881977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:21.926516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae50196-fa9b-42f8-815b-00eb82c22a52 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:21.961621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ffb6-333e-45f4-a2a0-047a6579f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:21.962293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ffb6-333e-45f4-a2a0-047a6579f444 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.962571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ffb6-333e-45f4-a2a0-047a6579f444 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.962843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ffb6-333e-45f4-a2a0-047a6579f444 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.963627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ffb6-333e-45f4-a2a0-047a6579f444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:21.963937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ffb6-333e-45f4-a2a0-047a6579f444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:21.965359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ffb6-333e-45f4-a2a0-047a6579f444 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:21.977333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 320/640] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:21.981975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd5345-26a3-4a1b-a0df-e9746cbe3684 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:21.981975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd5345-26a3-4a1b-a0df-e9746cbe3684 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:21.981975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd5345-26a3-4a1b-a0df-e9746cbe3684 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:21.981975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 321/641] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:21.981975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd5345-26a3-4a1b-a0df-e9746cbe3684 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.000814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a42e38-372f-4be8-986b-3ed90bbe8611 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.034875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.035663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.036046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.036331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.047133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:22.055285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:22.056287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 321/642] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:22.062358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.092354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd5345-26a3-4a1b-a0df-e9746cbe3684 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.135502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970493f-a10e-4ab2-8598-e07fd0f49d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.136120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970493f-a10e-4ab2-8598-e07fd0f49d20 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.136403 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970493f-a10e-4ab2-8598-e07fd0f49d20 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.136685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970493f-a10e-4ab2-8598-e07fd0f49d20 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.137384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970493f-a10e-4ab2-8598-e07fd0f49d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:22.137725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970493f-a10e-4ab2-8598-e07fd0f49d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.139179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970493f-a10e-4ab2-8598-e07fd0f49d20 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.157841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 322/643] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:22.160070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e932-25c3-456c-bd3e-aeb610ac67d3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.160352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e932-25c3-456c-bd3e-aeb610ac67d3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.160624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e932-25c3-456c-bd3e-aeb610ac67d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.178025 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4879e932-25c3-456c-bd3e-aeb610ac67d3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:22.179402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4879e932-25c3-456c-bd3e-aeb610ac67d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:22.181055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b355b85-a781-4cfe-b398-0fa39bc48435 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.214040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.214689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.214965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.215232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.216049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=ea420049f83643a19cb6c1d0a36fc8bc) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:22.216354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.217890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.224951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 322/644] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/role_assignments?user.id=ea420049f83643a19cb6c1d0a36fc8bc&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:22.226700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.257911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 323/645] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:22.259844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e932-25c3-456c-bd3e-aeb610ac67d3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.373572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b649-abc1-46b9-861d-27557a8bf689 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.398849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e932-25c3-456c-bd3e-aeb610ac67d3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.418029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.418699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.418974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.419242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.420190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:22.420495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.422732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.434236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 323/646] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:22.435263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.456095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.456902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.457182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.457456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.467793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.470650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:22.487393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:22.488402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:22.490026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 324/647] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:22.494247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.565225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3bb7-888b-4c49-bcd8-f41247ae671b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.601140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.602223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.602703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.603142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.607190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd65e-b490-4be0-8148-fe8e9d919ec3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.613902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:22.621867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:22.622984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:22.624007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:22.626042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 324/648] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:22.627038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.648019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.648809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.649136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.649360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.664219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.665682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:22.683728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:22.684636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:22.685634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:22.685634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:22.685634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:22.685634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:22.685634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 325/649] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:22.686316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.756241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cf18-6e9f-4816-bec8-53ada8e8e941 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.787153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4abc-d5c2-4f9b-98e0-8dae6786a52f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.805095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.806447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.806934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.807404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.808879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:22.809397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.811474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.822575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.823247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.823526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.823800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.824916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:22.824916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.826221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.835018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 325/651] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:22.835166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 326/651] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:22.837508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.840193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:22.943603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340915d-f6bb-4f43-9cea-ed9148be9c68 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.947872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732d7b-80be-4a0c-b072-9726abdf629d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:22.979845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.980856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.981292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.981717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.982665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:22.983134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:22.984644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:22.984784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:22.985651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:22.986104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:22.986540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:22.998480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 327/652] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:22.999523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.055499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.057226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.101933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67543a6-473e-4e67-bcb0-cb09df53e4fa None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.135836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.136719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.137067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.137410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.148684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.150242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.161810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 326/653] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:23.163031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:23.168602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:23.169486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:23.170671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:23.170671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:23.170671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:23.170671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:23.174541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 328/654] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:23.175459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.267346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1726d35-dbc5-43e8-bd8f-563342490725 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.285790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bdc31-aa70-441f-8fe6-1c880e2099c9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.303687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.304808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.305315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.305880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.313924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.315605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.325504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.326291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.326569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.326840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:23.335695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:23.336618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:23.337584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:23.343270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 327/655] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:23.343270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.344247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.345727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:23.366889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:23.368823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:23.370664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:23.370664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:23.370664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:23.370664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:23.370664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 329/656] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:23.370664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.470016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca07d-ac02-48fe-b8fe-498c41364f1f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.489541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a2f1-f046-45eb-af90-50de2b306091 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.513104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.514401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.515028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.515498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.516935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:23.517443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.519699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.524280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.525059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.525435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.525833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.526765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:23.527174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.528817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.535114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 328/657] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:23.536456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.552329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 330/658] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:23.552329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.655987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861ca63-b3a8-4e81-a40f-63cc85f1dff3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.658386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c54943-e834-4dc5-91bf-f5d483f590bf None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.691148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.691923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.692950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.693230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.694151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:23.694505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.696068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.699062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71847543-0546-46be-a66f-6261e2919116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.700081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847543-0546-46be-a66f-6261e2919116 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.700497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847543-0546-46be-a66f-6261e2919116 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.700906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847543-0546-46be-a66f-6261e2919116 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.709750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 329/659] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:23.709750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.712115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71847543-0546-46be-a66f-6261e2919116 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.715127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71847543-0546-46be-a66f-6261e2919116 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-71847543-0546-46be-a66f-6261e2919116 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:23.732992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:23.734186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:53:23.735345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:23.737373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 331/660] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:23.738257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71847543-0546-46be-a66f-6261e2919116 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.817303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc3f4f-2d14-46f5-b969-5201b7d30c2c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.843970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71847543-0546-46be-a66f-6261e2919116 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:23.853571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.854382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.854736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.855107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.882740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:23.883890 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:23.884366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:23.884832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:23.891915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.893727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:23.908042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:23.908962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:23.910250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:23.912956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 332/661] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:23.914041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:23.927429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:23.928895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.023099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01276bfa-c79f-40a4-9d71-95fcd3ac1105 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.033138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 330/662] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:24.033138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.061919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c0bf-9176-4037-a265-0cd2925d6c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.062577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c0bf-9176-4037-a265-0cd2925d6c6f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.062849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c0bf-9176-4037-a265-0cd2925d6c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.063124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c0bf-9176-4037-a265-0cd2925d6c6f None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.063944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018c0bf-9176-4037-a265-0cd2925d6c6f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:24.064246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018c0bf-9176-4037-a265-0cd2925d6c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.065679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018c0bf-9176-4037-a265-0cd2925d6c6f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.086567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 333/663] 10.222.0.69 () {56 vars in 1139 bytes} [Wed May 4 18:53:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:24.086567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e944c-61bc-4cc7-817e-167ebe242870 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.086567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e944c-61bc-4cc7-817e-167ebe242870 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.086567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e944c-61bc-4cc7-817e-167ebe242870 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.086567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 334/664] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:24.086567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e944c-61bc-4cc7-817e-167ebe242870 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.139328 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69fca-7678-4d93-bfed-a9a5d3dc0737 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.172505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.173165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.173446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.173748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.174527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:24.174833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.176252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.184911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e944c-61bc-4cc7-817e-167ebe242870 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.188093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 331/665] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:24.189033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.217648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6d9a-0cea-44c4-b547-24dc300280ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.218513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d9a-0cea-44c4-b547-24dc300280ab None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.218855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d9a-0cea-44c4-b547-24dc300280ab None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.219194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d9a-0cea-44c4-b547-24dc300280ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.229373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6d9a-0cea-44c4-b547-24dc300280ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.230835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6d9a-0cea-44c4-b547-24dc300280ab None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3b4c6d9a-0cea-44c4-b547-24dc300280ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:24.248208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:24.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:24.250340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:24.250340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:24.250340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:24.250340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:24.250340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 335/666] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:24.250906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739254f3-b3ba-4fd2-a550-51968478d229 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.251184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739254f3-b3ba-4fd2-a550-51968478d229 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.251454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739254f3-b3ba-4fd2-a550-51968478d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.267596 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-739254f3-b3ba-4fd2-a550-51968478d229 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:24.268763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-739254f3-b3ba-4fd2-a550-51968478d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:24.294818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0ad5-4fb1-4213-9fe6-3e1a13e58f2b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.326581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.327498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.327932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.328351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.335041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 336/667] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:24.335885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739254f3-b3ba-4fd2-a550-51968478d229 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.398179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.400665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.444869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739254f3-b3ba-4fd2-a550-51968478d229 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.479216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.479950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.480235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.480507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.481329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=eb9c380955a04c24af2823e22fe3ec70) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:24.481671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.483103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.488738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 337/668] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/role_assignments?user.id=eb9c380955a04c24af2823e22fe3ec70&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:24.489794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.521509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 332/669] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:24.521509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.626520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c1541-c605-4c98-bee7-11cd39b12baa None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.638916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1095b-ec82-42bc-814b-846bf07e48c3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.664307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.665152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.665549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.665900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.677623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:24.685410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:24.686377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:24.687216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 333/670] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:24.687908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.693209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.694132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.694250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.694502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.695232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:24.695521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.696873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.711733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 338/671] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:24.712572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.795137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbd08a-90f5-4929-ad56-46e7147c32e2 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.818069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d2cbd-7447-48e6-80d4-270d5b26652f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.828065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce4435-ce4d-420c-8e36-e094d09e02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.828854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4435-ce4d-420c-8e36-e094d09e02d7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.829130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4435-ce4d-420c-8e36-e094d09e02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.829400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4435-ce4d-420c-8e36-e094d09e02d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.840220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce4435-ce4d-420c-8e36-e094d09e02d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.841701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce4435-ce4d-420c-8e36-e094d09e02d7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.851350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:24.852182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.852625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.853053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.853960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:24.854402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:24.855942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-4fce4435-ce4d-420c-8e36-e094d09e02d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:24.858962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:24.859859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:24.860851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:24.860851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:24.860851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:24.860851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:24.860851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 334/672] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:24.865730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44f15-154a-45d0-a965-84f9ea5275ca None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:24.866014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44f15-154a-45d0-a965-84f9ea5275ca None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:24.866288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44f15-154a-45d0-a965-84f9ea5275ca None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:24.872319 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 339/673] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:24.872480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 335/674] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:24.872575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.872661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44f15-154a-45d0-a965-84f9ea5275ca None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:24.970099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aaf81-c880-499f-ba68-5b1e2f295f97 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:24.977513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44f15-154a-45d0-a965-84f9ea5275ca None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.003833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.005286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.005699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.006069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.012758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.013196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff283f86-ff3b-45df-9a5e-b4e16bef747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.013887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283f86-ff3b-45df-9a5e-b4e16bef747c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.014166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283f86-ff3b-45df-9a5e-b4e16bef747c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.014434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff283f86-ff3b-45df-9a5e-b4e16bef747c None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.014723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.015172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283f86-ff3b-45df-9a5e-b4e16bef747c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:25.015430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283f86-ff3b-45df-9a5e-b4e16bef747c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.016757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff283f86-ff3b-45df-9a5e-b4e16bef747c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.028510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 336/675] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:25.029796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8137d-938f-491e-adb7-52524735026a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.030079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8137d-938f-491e-adb7-52524735026a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:25.030301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:25.031453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:25.032343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:25.032770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8137d-938f-491e-adb7-52524735026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.034134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 340/676] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:25.035075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.051445 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ada8137d-938f-491e-adb7-52524735026a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:25.053138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ada8137d-938f-491e-adb7-52524735026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:25.116414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 337/677] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:25.117662 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8137d-938f-491e-adb7-52524735026a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.156259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35de63-39a2-436f-ad32-ef966a8f5e0f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.188449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.189235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.189848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.189848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.199528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.201011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.212935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8137d-938f-491e-adb7-52524735026a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:25.218446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:25.219339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:25.225609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:25.225609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:25.225609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:25.225609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:25.225609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 341/678] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:25.225609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.252562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.253436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.253808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.254149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.260785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.262356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:25.276589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:25.277801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:25.278890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:25.279572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 338/679] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:25.282326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.326745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3dd20-fa56-46e4-8ec9-b6c59c595b84 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.360802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.361809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.362299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.362641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.363492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:25.363809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.365295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.381440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 342/680] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:25.381440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.384195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e133c-1eea-438f-9b7c-67ab0dae233d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.422455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.423410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.423761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.424107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.434525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:25.442029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:25.443704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:25.444746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:25.448623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 339/681] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:25.449354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.477345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a63a-f962-488f-8c31-f307c0da0029 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.509766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.510528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.510814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.511091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.511808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:25.512118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.513494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.525756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 343/682] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:25.526554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.558550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e25af-caca-472f-8cfe-ed39c2a19c0c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.593583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.594246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.594525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.594797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.595581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:25.595887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.597304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.609187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 340/683] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:25.610347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.626417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2848ab-1559-4d6e-a17d-ad3a082afdc8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.659695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.660349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.660636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.660934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.661801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=e39540c05b40402786e682d974ee6018) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:25.662113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.663532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.677726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 344/684] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/role_assignments?user.id=e39540c05b40402786e682d974ee6018&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:25.677726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.738648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760c798-8887-4ebb-a6b8-03243f7557b7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.778814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.779494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.779841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.780117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.780923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:25.781233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.782709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.792096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 341/685] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:25.792968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.804484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08675240-836b-4919-bf43-4590c03b6293 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.844231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.845089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.845370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.845686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.854127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.855607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:25.871303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:25.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:25.873454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 345/686] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:25.874092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:25.921337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518b69-d65d-4f11-89e2-a9fc8fb6b4ed None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:25.955871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:25.956530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:25.956812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:25.957088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:25.957989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=39f773f90b8c47608040ee24866242f2) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:25.958305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:25.959742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:25.966750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 342/687] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/role_assignments?user.id=39f773f90b8c47608040ee24866242f2&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:25.967814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:26.042790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a428b-1007-4d73-b3d2-22739aad4255 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:26.110592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:26.111864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:26.112313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:26.112835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:26.132142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:26.133897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:26.170091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2f09-cecf-47e2-b3a9-6421cb2570a7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:26.172817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:26.174453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:26.176350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:26.176350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:26.176350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:26.176350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:26.179816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 346/688] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:26.184935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:26.221325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:26.226770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:26.227436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:26.228078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:26.229452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:26.229927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:26.231550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:26.254915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 343/689] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 18:53:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:26.256463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:26.297978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff40cc-1c04-44ee-b58d-0ba8df109c71 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:26.332978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:26.333666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:26.333947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:26.334222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:26.334952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:26.335254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:26.336625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:26.350706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 347/690] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:26.357144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:26.359863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61cc73-a328-4946-88ef-325e54866c59 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:26.394117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:26.395010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:26.395718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:26.396160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:26.457063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483b5b-0f44-49af-b301-bcf9255b81f9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:26.465143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:26.466822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:26.494291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:26.495110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:26.495389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:26.495664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:26.504628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:26.506144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:26.522416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:26.524553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:26.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 348/691] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:53:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:26.530608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:26.658008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ce36-8d30-4720-8bed-c16cf0fee17e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:26.691659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:26.692320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:26.692602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:26.692876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:26.693743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:26.694052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:26.695482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:26.713842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 349/692] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:53:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:26.719157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:26.752196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 344/693] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:53:26.758519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:26.834270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bec67-a550-472b-b440-dd6835e5f6b5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:26.873499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:26.874570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:26.875627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:26.876388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:26.970268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:26.972454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.047388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e652d7-b716-447e-a184-6e8a5463d232 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.078872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 350/694] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:27.085797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.116074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff04ec-d8db-4540-bad7-cb990ccdda40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.117358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff04ec-d8db-4540-bad7-cb990ccdda40 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.117358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff04ec-d8db-4540-bad7-cb990ccdda40 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.117603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff04ec-d8db-4540-bad7-cb990ccdda40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.127858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff04ec-d8db-4540-bad7-cb990ccdda40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.129301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff04ec-d8db-4540-bad7-cb990ccdda40 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-61ff04ec-d8db-4540-bad7-cb990ccdda40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:27.148001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:27.149096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:27.150174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:27.150174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:27.150174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:27.150174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:27.153589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 345/695] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:27.154971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307ad3-2d2c-4244-bf71-e6de4325124b None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.155262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307ad3-2d2c-4244-bf71-e6de4325124b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.155540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307ad3-2d2c-4244-bf71-e6de4325124b None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.160866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 346/696] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:27.160866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307ad3-2d2c-4244-bf71-e6de4325124b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.217872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73339f-e31e-4cf3-aec4-4bc3e81877a1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.256754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569da8f6-79d8-475b-840d-823311486b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.257481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da8f6-79d8-475b-840d-823311486b08 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.257763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da8f6-79d8-475b-840d-823311486b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.258034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da8f6-79d8-475b-840d-823311486b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.275454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569da8f6-79d8-475b-840d-823311486b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.277963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569da8f6-79d8-475b-840d-823311486b08 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.281316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307ad3-2d2c-4244-bf71-e6de4325124b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-569da8f6-79d8-475b-840d-823311486b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:27.303502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:27.304444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:27.305434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:27.305434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:27.305434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:27.305434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:27.307914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 351/697] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:27.309969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80934-3351-4da0-880a-fac300eb9cfe None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.310389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80934-3351-4da0-880a-fac300eb9cfe None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.310818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80934-3351-4da0-880a-fac300eb9cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.324116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.325432 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.325908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.326343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.327608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:27.328073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.329604 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.330831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c1c80934-3351-4da0-880a-fac300eb9cfe None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:27.332717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c1c80934-3351-4da0-880a-fac300eb9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:27.348163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 347/698] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:27.348163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.417620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 352/699] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:27.419549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c80934-3351-4da0-880a-fac300eb9cfe None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.475331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3abb-3426-4dd5-8616-cf8a1e7f2b16 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.510161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.511053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.511486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.511957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.512829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:27.513326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.514927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.527800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 348/700] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:27.528837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.539065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c80934-3351-4da0-880a-fac300eb9cfe None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.577758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.578744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.579118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.579486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.587620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.589927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:27.604695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:27.605716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:27.606672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:27.610780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 353/701] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:27.611718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.648354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cefda-6377-45d3-9315-6d29be4d09a0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.683028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.684200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.684685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.685157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.695538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.697257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.710743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387494e-5212-4441-837a-37aafc01d6f1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:27.718446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:27.719343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:27.720225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:27.720225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:27.720225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:27.720225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:27.722988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 349/702] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:27.724576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.749938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.750837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.751051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.751320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.758129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.759608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:27.774282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:27.775201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:27.776091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:27.780104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 354/703] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:27.780941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.836988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8486995-42bb-4f61-bc7b-201b7b00398f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.871546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.872201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.872479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.872793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.873599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:27.873988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.875980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.886408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31a13-bb8f-4452-8d4b-66a4e3c7b218 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:27.896908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 350/704] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:27.897863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:27.926118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:27.927766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:27.928246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:27.928736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:27.929924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:27.930446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:27.932021 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:27.944533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 355/705] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:27.945709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:28.029012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850b611-f1ba-48af-a2a7-810c0174ce56 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:28.049029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45115bb-90a5-4a2b-aceb-ab059d0393a9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:28.073925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:28.074588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.074871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.075144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.076196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:28.076502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:28.078418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:28.086150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:28.087488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.087974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.088443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.089587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=0e9763d8a5c040ce876a787bed7fc954) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:28.090101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:28.091729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:28.096836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 351/706] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:28.097887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:28.100063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 356/707] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:27 2022] GET /identity/v3/role_assignments?user.id=0e9763d8a5c040ce876a787bed7fc954&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:28.101286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:28.210216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b575-3e26-435d-bcfa-7b919bfafad9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:28.246584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e5ee-754e-4009-8bca-462876be432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:28.248039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e5ee-754e-4009-8bca-462876be432c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.248555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e5ee-754e-4009-8bca-462876be432c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.249031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e5ee-754e-4009-8bca-462876be432c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.250139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58e5ee-754e-4009-8bca-462876be432c None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=ea420049f83643a19cb6c1d0a36fc8bc) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:28.250676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58e5ee-754e-4009-8bca-462876be432c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:28.252373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58e5ee-754e-4009-8bca-462876be432c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:28.263960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 357/708] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:28 2022] GET /identity/v3/role_assignments?user.id=ea420049f83643a19cb6c1d0a36fc8bc&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:28.277752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d767320-725d-4bce-b0a2-1022d47bca4d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:28.325632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:28.327231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.327733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.328317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.329313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:28.331088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:28.364633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775fad-7034-46e1-a57d-f5f06f18e584 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.365340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775fad-7034-46e1-a57d-f5f06f18e584 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.365965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775fad-7034-46e1-a57d-f5f06f18e584 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.367962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 358/709] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:28.374608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf6187-b78d-4419-850a-83b4bdd66121 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.374832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf6187-b78d-4419-850a-83b4bdd66121 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.375118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf6187-b78d-4419-850a-83b4bdd66121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.378547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 352/710] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:53:28 2022] POST /identity/v3/users => generated 254 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:28.402022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6aaf6187-b78d-4419-850a-83b4bdd66121 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:28.403796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6aaf6187-b78d-4419-850a-83b4bdd66121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:28.505939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 359/711] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:53:28.531670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:28.644531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78625c2-50cf-438f-b741-08568ecda491 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:28.681377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e30666-3003-4149-8a92-7fa544b0e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:28.682619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30666-3003-4149-8a92-7fa544b0e28c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.683109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30666-3003-4149-8a92-7fa544b0e28c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.683623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30666-3003-4149-8a92-7fa544b0e28c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.684504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e30666-3003-4149-8a92-7fa544b0e28c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:28.686105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e30666-3003-4149-8a92-7fa544b0e28c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-f4e30666-3003-4149-8a92-7fa544b0e28c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:28.700763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:28.701840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:28.702710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:28.704989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 353/712] 10.222.0.69 () {56 vars in 1129 bytes} [Wed May 4 18:53:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:28.711020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf6187-b78d-4419-850a-83b4bdd66121 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:28.743913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017ed07-076e-491b-aa1a-0ef71af0a354 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.744256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017ed07-076e-491b-aa1a-0ef71af0a354 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.744464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017ed07-076e-491b-aa1a-0ef71af0a354 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.746107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 354/713] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:28.753037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3280d-d9bb-4620-ac15-23d7d5ec59ee None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.753315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3280d-d9bb-4620-ac15-23d7d5ec59ee None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.753617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3280d-d9bb-4620-ac15-23d7d5ec59ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.779914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0ed3280d-d9bb-4620-ac15-23d7d5ec59ee None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:28.781099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0ed3280d-d9bb-4620-ac15-23d7d5ec59ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:28.863552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf6187-b78d-4419-850a-83b4bdd66121 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:28.894443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 355/714] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:28.917728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3280d-d9bb-4620-ac15-23d7d5ec59ee None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:28.928740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:28.929747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:28.930227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:28.930716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:28.931632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:28.932132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:28.933702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:28.945089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 360/715] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 18:53:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:28.950689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:29.021917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3280d-d9bb-4620-ac15-23d7d5ec59ee None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:29.059085 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:29.059880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:29.060159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:29.060437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] PATH_INFO: `/v3/services/network` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:29.061082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:29.062471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:29.086036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:29.087046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:29.087875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:29.093482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 356/716] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:28 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:29.100886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:29.149263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f5f17-4aa7-416e-a101-40f8294cae86 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:29.215787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:29.216374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:29.216651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:29.216922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:29.217648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:29.217951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:29.219470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:29.239367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 361/717] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 18:53:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:29.266259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800840c7-0e95-4b4c-89ef-ecb69db7b324 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:29.319489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312dc8b-1992-4fdc-8b33-6b52c2852cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:29.320178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312dc8b-1992-4fdc-8b33-6b52c2852cda None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:29.320478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312dc8b-1992-4fdc-8b33-6b52c2852cda None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:29.320755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312dc8b-1992-4fdc-8b33-6b52c2852cda None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:29.321507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312dc8b-1992-4fdc-8b33-6b52c2852cda None admin] RBAC: Adding query filter params (name=network) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:29.321822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312dc8b-1992-4fdc-8b33-6b52c2852cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:29.323193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312dc8b-1992-4fdc-8b33-6b52c2852cda None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:29.328583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 357/718] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:29.334541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:29.484336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bc2d3-0e1e-42f7-a8e0-6b1267143144 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:29.530556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8779543-0603-4baf-9897-55c31a91a1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:29.531217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779543-0603-4baf-9897-55c31a91a1c8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:29.531490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779543-0603-4baf-9897-55c31a91a1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:29.531761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779543-0603-4baf-9897-55c31a91a1c8 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:29.532463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8779543-0603-4baf-9897-55c31a91a1c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:29.532838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8779543-0603-4baf-9897-55c31a91a1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:29.534301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8779543-0603-4baf-9897-55c31a91a1c8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:29.540548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 362/719] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:31.052029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b312e1-8516-41b6-9515-eb7fd13a80ef None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.052538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b312e1-8516-41b6-9515-eb7fd13a80ef None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.052538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b312e1-8516-41b6-9515-eb7fd13a80ef None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.054972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2c6c-5a29-41f5-8446-1c30c04097d9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.055350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2c6c-5a29-41f5-8446-1c30c04097d9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.055537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2c6c-5a29-41f5-8446-1c30c04097d9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.057144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 363/720] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:31.057881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 358/721] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:31.063035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36816bb-b174-4c0b-8e50-cef0af578150 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.063170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122939d4-2683-4fcf-aa53-300830c57395 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.063417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36816bb-b174-4c0b-8e50-cef0af578150 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.063515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122939d4-2683-4fcf-aa53-300830c57395 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.063589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36816bb-b174-4c0b-8e50-cef0af578150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.063658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122939d4-2683-4fcf-aa53-300830c57395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.080633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a36816bb-b174-4c0b-8e50-cef0af578150 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:31.081837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a36816bb-b174-4c0b-8e50-cef0af578150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:31.087345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-122939d4-2683-4fcf-aa53-300830c57395 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:31.092635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-122939d4-2683-4fcf-aa53-300830c57395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:31.191715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 364/722] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:53:31.207997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 359/723] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:53:31.217946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339422-b4b3-4aa6-9f11-0ebbb8dbcf63 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.218230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339422-b4b3-4aa6-9f11-0ebbb8dbcf63 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.218508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339422-b4b3-4aa6-9f11-0ebbb8dbcf63 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.220108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 365/724] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:31.225231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6adee-8b79-4ffd-805a-fd4ab7c8d845 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.225448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6adee-8b79-4ffd-805a-fd4ab7c8d845 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.225765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6adee-8b79-4ffd-805a-fd4ab7c8d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.228749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339422-b4b3-4aa6-9f11-0ebbb8dbcf63 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.244325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c9f6adee-8b79-4ffd-805a-fd4ab7c8d845 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:31.245527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c9f6adee-8b79-4ffd-805a-fd4ab7c8d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:31.313506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 360/725] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:31.314404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6adee-8b79-4ffd-805a-fd4ab7c8d845 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.330721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339422-b4b3-4aa6-9f11-0ebbb8dbcf63 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:31.364606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:31.365474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.365760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.366013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.376676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:31.384847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:31.387076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 366/726] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:31.389186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.444712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6adee-8b79-4ffd-805a-fd4ab7c8d845 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:31.479878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:31.480924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.481484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.481791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.485828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038190-004d-44a9-a6e1-bc3349137112 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:31.495603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:31.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:31.506974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 361/727] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:31.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.525025 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:31.525933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.526274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.526613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.537213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:31.545024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:31.547113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 367/728] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:31.548976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.624200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702dd69-9dd1-440b-806d-609694be72f7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:31.657225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94965db-6bee-4a5c-87ab-7bd0ff502ce8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:31.657835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:31.658518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.658799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.659071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.659883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:31.660129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:31.662253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:31.675192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 362/729] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:31.676075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.694408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:31.695369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.695866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.696333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.697274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:31.697821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:31.699406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:31.708428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 368/730] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:31.709499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.777065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611b29e-2343-44ff-98a0-ab305a06a745 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:31.810469 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:31.811151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.811492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.811737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.812539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:31.812852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:31.814285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:31.823680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 363/731] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:31.824617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.835340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf9fef-c5d7-4fff-baff-8a5778fc080d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:31.871490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:31.872335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:31.872615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:31.872930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:31.883813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:31.885320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:31.902897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:31.903811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:31.904682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:31.904682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:31.904682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:31.904682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:31.908792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 369/732] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:31.909749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:31.952190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0cbf-3c0e-46b8-88ed-e38b31e305c7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.005315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.006444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.006817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.007499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.019459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aafd2-acce-4a11-9c8f-13eb849aec85 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.019639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.021645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:32.040140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:32.041067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:32.042036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:32.042036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:32.042036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:32.042036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:32.042036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 364/733] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:32.042820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.056551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf284cbb-6f8a-4fb5-80a6-ad55115f3cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.057338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf284cbb-6f8a-4fb5-80a6-ad55115f3cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.057646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf284cbb-6f8a-4fb5-80a6-ad55115f3cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.057922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf284cbb-6f8a-4fb5-80a6-ad55115f3cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.068240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf284cbb-6f8a-4fb5-80a6-ad55115f3cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.069694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf284cbb-6f8a-4fb5-80a6-ad55115f3cc9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-cf284cbb-6f8a-4fb5-80a6-ad55115f3cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:32.086751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:32.087741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:32.088651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:32.088651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:32.088651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:32.088651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:32.088651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 370/734] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:32.089369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf571d-2c8f-4cb6-992c-ec6fba541ae5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.089493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf571d-2c8f-4cb6-992c-ec6fba541ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.089731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf571d-2c8f-4cb6-992c-ec6fba541ae5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.091135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 371/735] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:32.093900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf571d-2c8f-4cb6-992c-ec6fba541ae5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.143391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da58517-5bbd-4248-b3bd-161af9ef6acc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.177791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.178454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.178734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.179004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.179724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:32.180030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.181415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.199295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 365/736] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:32.199295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.201429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf571d-2c8f-4cb6-992c-ec6fba541ae5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.236227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a18a-d91c-4298-9f22-15695f63b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.236887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a18a-d91c-4298-9f22-15695f63b9be None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.237162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a18a-d91c-4298-9f22-15695f63b9be None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.237432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a18a-d91c-4298-9f22-15695f63b9be None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.238174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a18a-d91c-4298-9f22-15695f63b9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:32.238475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a18a-d91c-4298-9f22-15695f63b9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.239860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a18a-d91c-4298-9f22-15695f63b9be None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.255628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 372/737] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:32.257559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736f8f1-7279-428c-af8e-0865833941f9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.257850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736f8f1-7279-428c-af8e-0865833941f9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.258124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736f8f1-7279-428c-af8e-0865833941f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.275319 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f736f8f1-7279-428c-af8e-0865833941f9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:32.276474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f736f8f1-7279-428c-af8e-0865833941f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:32.296908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2246-a936-493a-be8f-7087bb76bd64 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.332234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.333869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.334374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.334842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.335750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:32.336250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.337804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.341422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 373/738] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:32.342291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736f8f1-7279-428c-af8e-0865833941f9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.360777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 366/739] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:32.361945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.441027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736f8f1-7279-428c-af8e-0865833941f9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.459640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b06a8-6ac2-4c75-b19e-55e04760b3fa None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.473369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.474181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.474461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.474732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.481477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.482934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.490048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.490820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.491096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.491360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:32.496887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:32.497988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 374/740] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:32.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.500565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.502043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:32.516481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:32.517571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:32.518520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 367/741] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:32.519117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.591747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b1bd7-3e22-4798-b3cf-aa7e7b966dcc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.611137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c11504-3615-4576-8a6b-2a2df55b48b1 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.623682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1af0ea-bac6-40ff-aa09-e3f6d078db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.624467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1af0ea-bac6-40ff-aa09-e3f6d078db66 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.624737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1af0ea-bac6-40ff-aa09-e3f6d078db66 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.625008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1af0ea-bac6-40ff-aa09-e3f6d078db66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.632140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1af0ea-bac6-40ff-aa09-e3f6d078db66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.633582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1af0ea-bac6-40ff-aa09-e3f6d078db66 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.642941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.643590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.643870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.644144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.644844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.646467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-4c1af0ea-bac6-40ff-aa09-e3f6d078db66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:32.647896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:32.648948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:32.650103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 375/742] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:32.650797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912c9bf-57a8-4dbe-9f21-fe6a7830fc2d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.650797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912c9bf-57a8-4dbe-9f21-fe6a7830fc2d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.650797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912c9bf-57a8-4dbe-9f21-fe6a7830fc2d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.652023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 376/743] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:32.652702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912c9bf-57a8-4dbe-9f21-fe6a7830fc2d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.668391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 368/744] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:53:32 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:32.669289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.779486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b663cb-6270-483d-9176-b963fa8ce9d1 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.781022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912c9bf-57a8-4dbe-9f21-fe6a7830fc2d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.814017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.814531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fe74b-c95b-4466-8426-337b33af5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.814722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.814970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.815200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe74b-c95b-4466-8426-337b33af5c2a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.815303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.815477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe74b-c95b-4466-8426-337b33af5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.815749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe74b-c95b-4466-8426-337b33af5c2a None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.816123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:32.816434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.816581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fe74b-c95b-4466-8426-337b33af5c2a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:32.817566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fe74b-c95b-4466-8426-337b33af5c2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.818474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.819085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fe74b-c95b-4466-8426-337b33af5c2a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:32.837136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 369/745] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:32.838350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.842060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 377/746] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:32.843422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f724e5-c9de-402a-b32d-202201221c5b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.843703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f724e5-c9de-402a-b32d-202201221c5b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.843982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f724e5-c9de-402a-b32d-202201221c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.866702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-97f724e5-c9de-402a-b32d-202201221c5b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:32.867958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-97f724e5-c9de-402a-b32d-202201221c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:32.936562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 378/747] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:53:32.937422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f724e5-c9de-402a-b32d-202201221c5b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:32.952370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd77c36-e44b-4d29-b76b-97881caed37e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:32.990308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:32.991041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:32.991322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:32.991589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:32.992426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:32.992734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:32.994185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.010572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 370/748] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:33.011385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.046563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f724e5-c9de-402a-b32d-202201221c5b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.080095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.080892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.081176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.081447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.091735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.093239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.106128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9428f-7751-4a86-9d92-912e7d0eb667 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:33.110903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:33.111764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:33.112703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:33.112703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:33.112703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:33.112703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:33.117132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 379/749] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:33.117848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.142202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.142841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.143121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.143386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.211641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.213082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.213687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23eb6-356c-4a71-b839-9780e7298f7e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.251287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.252170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.252590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.253013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.253884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.255402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.269751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 380/750] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:53:33 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:33.271095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.330672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 371/751] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:53:33.331872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.452222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe34b5f-2723-4ccc-a9ac-10ba1493825f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.500043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.500719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.500997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.501266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.502018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:33.502325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.503696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.518471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 372/752] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:33.518876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d546ae5-5c3a-410a-ac2e-f3a9b3523ba0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.519126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.558508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.559511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.560017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.560502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.627597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.629410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.648183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de1a0-f24b-4659-b372-2efb6c6b5a19 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.692588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.693390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.693700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.693975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.707036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.709572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:33.729943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:33.730855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:33.731746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:33.731746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:33.731746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:33.731746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:33.733964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 373/753] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:33.735039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.743844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 381/754] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:53:33.743844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.838747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46516c46-14b4-45f8-a2da-938f455763eb None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.866183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c600382-f483-4f92-b84b-a4a79cf52081 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:33.875704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.876866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.877149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.877427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.886668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.888533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.902040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:33.902931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:33.903401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:33.903932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:33.904830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:33.905322 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:33.906157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:33.907016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 374/755] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:33.913243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:33.914022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:33.928760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 382/756] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:33.929509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.021885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3927e-aa4c-4470-8833-9969204cfe1a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.029157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9eac-28b5-44ba-b4a1-2abe1b72e028 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.057087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.058235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.058755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.059324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.062534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.063263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.063613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.063955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.064807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:34.065183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.066702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.071671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.073286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.084306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 383/757] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:34.084306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:34.095112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:34.096076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:34.097610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:34.097610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:34.097610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:34.097610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:34.100864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 375/758] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:34.101675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.188171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152e9b1-ea6e-487f-bfe2-261c419b96c1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.204755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dd2c-f32c-4d19-8810-e91486e293c6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.222724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.223917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.224468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.224931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.231953 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.233656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.239210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.240110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.240389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.240659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/ea420049f83643a19cb6c1d0a36fc8bc/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.242693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=ea420049f83643a19cb6c1d0a36fc8bc, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.244095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:34.250854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:34.251796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:34.252684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:34.257890 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 384/759] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:34.259105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.263731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 376/760] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:34 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/ea420049f83643a19cb6c1d0a36fc8bc/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:34.264853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.374645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74c0c-c8e9-4dd7-ac7b-d933ec15e512 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.412682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.413776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.414285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.414757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.415756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:34.416290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.418008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.433117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 377/761] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:34.440262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.488069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8855253-1797-4919-8991-8e267caaecd0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.532459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.533180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.533449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.533835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.534522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:34.534831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.536725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.551096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 385/762] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:34.558897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.567863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9cb8e-d97c-4523-b6bc-0197f3f5f519 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.602021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.603043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.603526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.603998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.605038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=0e9763d8a5c040ce876a787bed7fc954) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:34.605612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.607231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.613477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 378/763] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:34 2022] GET /identity/v3/role_assignments?user.id=0e9763d8a5c040ce876a787bed7fc954&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:34.674028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac037c3-9d76-4c28-b438-014324c178f3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.710406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.711605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.712095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.712583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.720430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.722317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:34.737389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:34.738500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:34.740031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:34.742620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 386/764] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:34.750742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:34.868130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a44f-2517-457b-835a-8aa0ea15ca95 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:34.904080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf69aae-ae7f-459e-8848-e9fb87c73891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:34.905174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69aae-ae7f-459e-8848-e9fb87c73891 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:34.905698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69aae-ae7f-459e-8848-e9fb87c73891 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:34.906175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69aae-ae7f-459e-8848-e9fb87c73891 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:34.907156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69aae-ae7f-459e-8848-e9fb87c73891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:34.907704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69aae-ae7f-459e-8848-e9fb87c73891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:34.909318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69aae-ae7f-459e-8848-e9fb87c73891 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:34.924105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 379/765] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:34.929848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:35.037335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa97ab-d72b-4ddb-853f-bcc016a6eefc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:35.070683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e741a-d1ef-4609-9694-b0a87e2b4225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:35.071699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e741a-d1ef-4609-9694-b0a87e2b4225 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:35.072181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e741a-d1ef-4609-9694-b0a87e2b4225 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:35.072709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e741a-d1ef-4609-9694-b0a87e2b4225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:35.073809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e741a-d1ef-4609-9694-b0a87e2b4225 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=3c6b49d2b3904ceca7db22423b2e7a7e) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:35.074336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e741a-d1ef-4609-9694-b0a87e2b4225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:35.075946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e741a-d1ef-4609-9694-b0a87e2b4225 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:35.082014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 387/766] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:34 2022] GET /identity/v3/role_assignments?user.id=3c6b49d2b3904ceca7db22423b2e7a7e&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:35.194536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4494f7-4ec3-4252-b5aa-66caf45593a3 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:35.195241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4494f7-4ec3-4252-b5aa-66caf45593a3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:35.195765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4494f7-4ec3-4252-b5aa-66caf45593a3 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:35.197444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 380/767] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:35.211777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d24dd-ca0a-4d02-90bb-3e911ca1a1a9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:35.212300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d24dd-ca0a-4d02-90bb-3e911ca1a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:35.212300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d24dd-ca0a-4d02-90bb-3e911ca1a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:35.233999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fb9d24dd-ca0a-4d02-90bb-3e911ca1a1a9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:35.235207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fb9d24dd-ca0a-4d02-90bb-3e911ca1a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:35.331226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 388/768] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:35.382340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4494f7-4ec3-4252-b5aa-66caf45593a3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:35.530072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4494f7-4ec3-4252-b5aa-66caf45593a3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:35.574524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:35.575331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:35.575611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:35.575887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:35.576535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:35.577928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:35.593575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:35.594505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:35.595345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 381/769] 10.222.0.69 () {56 vars in 1129 bytes} [Wed May 4 18:53:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:35.600699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d24dd-ca0a-4d02-90bb-3e911ca1a1a9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:35.747889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d24dd-ca0a-4d02-90bb-3e911ca1a1a9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:35.797968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:35.798653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:35.798934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:35.799208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:35.799928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:35.800234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:35.802163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:35.809772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 389/770] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 18:53:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:35.815495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:35.922837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534f2e0-f35f-442d-9cd7-5cc77a3f9891 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:35.968580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030a952-441d-4b08-942f-8cdd30494795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:35.969257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030a952-441d-4b08-942f-8cdd30494795 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:35.972567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030a952-441d-4b08-942f-8cdd30494795 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:35.972567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030a952-441d-4b08-942f-8cdd30494795 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:35.972567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030a952-441d-4b08-942f-8cdd30494795 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:35.972567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030a952-441d-4b08-942f-8cdd30494795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:35.972848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030a952-441d-4b08-942f-8cdd30494795 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:35.982722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 382/771] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 18:53:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:35.988321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:36.036370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc54fe-3a7f-4aab-b7d4-5df96718c7a3 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:36.036813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc54fe-3a7f-4aab-b7d4-5df96718c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:36.037195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc54fe-3a7f-4aab-b7d4-5df96718c7a3 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:36.038961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 383/772] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:36.044773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdefd5-6fba-41fb-89bf-cdeb71fdca66 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:36.045200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdefd5-6fba-41fb-89bf-cdeb71fdca66 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:36.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdefd5-6fba-41fb-89bf-cdeb71fdca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:36.073192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e3cdefd5-6fba-41fb-89bf-cdeb71fdca66 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:36.074587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e3cdefd5-6fba-41fb-89bf-cdeb71fdca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:36.138865 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc864-8802-4699-9ee7-ba9fe32d1a59 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:36.177356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:36.177962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:36.178236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:36.178508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:36.179299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] RBAC: Adding query filter params (interface=public, service_id=8bb224be8cbc4b0a8840df3a229ae4d9, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:36.179608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:36.180980 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:36.195749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 390/773] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:53:35 2022] GET /identity/v3/endpoints?service_id=8bb224be8cbc4b0a8840df3a229ae4d9&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:36.202217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:36.208483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 384/774] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:53:36.270408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdefd5-6fba-41fb-89bf-cdeb71fdca66 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:36.328073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6f3b-e104-414b-baaa-341ca78c0657 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:36.362783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:36.363452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:36.363768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:36.364043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:36.364729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:36.366115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:36.371534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 391/775] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:53:36 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:36.426358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdefd5-6fba-41fb-89bf-cdeb71fdca66 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:36.465956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:36.466676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:36.466958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:36.467234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] PATH_INFO: `/v3/services/network` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:36.467886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:36.469251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:36.482481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:36.484902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:36.486972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 385/776] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:36 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:36.493513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:36.601920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74b4c6-9f00-4bc1-ae18-662b39da9d81 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:36.636290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:36.636964 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:36.637246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:36.637550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:36.638277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] RBAC: Adding query filter params (name=network) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:36.638582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:36.639989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:36.646066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 392/777] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:36.651719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:36.815400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92e83b-4fb0-4fbe-b0d4-7128a9cfde87 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:36.918788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b45d5d-1daa-487b-b818-949d171632e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:36.919477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b45d5d-1daa-487b-b818-949d171632e0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:36.919760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b45d5d-1daa-487b-b818-949d171632e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:36.920038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b45d5d-1daa-487b-b818-949d171632e0 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:36.920759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b45d5d-1daa-487b-b818-949d171632e0 None admin] RBAC: Adding query filter params (type=network) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:36.921143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b45d5d-1daa-487b-b818-949d171632e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:36.922557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b45d5d-1daa-487b-b818-949d171632e0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:36.941488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 386/778] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:36.947669 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:37.127641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424f9bd-61b6-4265-8565-aa523882bfb5 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.127837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424f9bd-61b6-4265-8565-aa523882bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.128116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424f9bd-61b6-4265-8565-aa523882bfb5 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.129681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 387/779] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:53:37.134339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13a6fb-fe68-4d68-aa41-d6b58688d6bf None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.134624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13a6fb-fe68-4d68-aa41-d6b58688d6bf None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.134905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13a6fb-fe68-4d68-aa41-d6b58688d6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.143546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9630fc3-d5ca-4c43-be7e-ff5d72134fbf None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:37.161884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1d13a6fb-fe68-4d68-aa41-d6b58688d6bf None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:37.163069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1d13a6fb-fe68-4d68-aa41-d6b58688d6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:37.209766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:37.210427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.210709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.210978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.211763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] RBAC: Adding query filter params (interface=public, service_id=32fe08305c3f4a98a6247420d06462bf, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:37.212076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:37.213436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:37.225757 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 393/780] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:53:36 2022] GET /identity/v3/endpoints?service_id=32fe08305c3f4a98a6247420d06462bf&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:37.230265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:37.288939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 388/781] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:37.324025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13a6fb-fe68-4d68-aa41-d6b58688d6bf None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:37.400454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e07ec-6478-463a-8617-1f69245a8f93 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:37.461963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1ad72-6459-4a5f-a5c9-8a5ad5f80117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:37.462796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ad72-6459-4a5f-a5c9-8a5ad5f80117 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.464062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ad72-6459-4a5f-a5c9-8a5ad5f80117 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.464348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ad72-6459-4a5f-a5c9-8a5ad5f80117 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.465036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1ad72-6459-4a5f-a5c9-8a5ad5f80117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:37.466436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1ad72-6459-4a5f-a5c9-8a5ad5f80117 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:37.491704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 394/782] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:53:37 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:37.515430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13a6fb-fe68-4d68-aa41-d6b58688d6bf None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:37.543480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816e8fa-2d6c-40aa-bcc2-6a913e9b0971 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.543819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816e8fa-2d6c-40aa-bcc2-6a913e9b0971 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.545630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816e8fa-2d6c-40aa-bcc2-6a913e9b0971 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.549600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 395/783] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:53:37.551151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f6840-03c2-4a09-afe7-0715b3f6eda2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.551438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f6840-03c2-4a09-afe7-0715b3f6eda2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.557509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f6840-03c2-4a09-afe7-0715b3f6eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.565316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:37.566159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.566442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.567250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.579510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:37.589539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:37.590742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:37.591774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 389/784] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:37.595503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:37.613756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c93f6840-03c2-4a09-afe7-0715b3f6eda2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:37.615423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c93f6840-03c2-4a09-afe7-0715b3f6eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:37.786297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 396/785] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:37.809917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f6840-03c2-4a09-afe7-0715b3f6eda2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:37.814011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001f8d-9989-4e8a-bb16-6d9ca2945fa6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:37.848837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:37.849616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.849903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.850174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.850923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:37.851228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:37.852604 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:37.862469 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 390/786] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:37.868273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:37.924866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f6840-03c2-4a09-afe7-0715b3f6eda2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:37.961235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:37.962459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:37.962987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:37.963461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:37.974241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:37.979285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e369f8-08b9-472f-a883-4f1c117aab44 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:37.982505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:37.983663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:37.984540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:37.985298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 397/787] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:37.991849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.013611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.014408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.014688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.014959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.026633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.028081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:38.045083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:38.046048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:38.046935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:38.046935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:38.046935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:38.046935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:38.046935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 391/788] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:38.052570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.141140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cce30-e39a-45d9-93b0-8bff33b886df None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.152389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f728-b5a8-452a-af9f-fe966315e731 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.174706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c9e5-09e1-49c1-acd1-5b63666b0403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.175383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c9e5-09e1-49c1-acd1-5b63666b0403 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.175663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c9e5-09e1-49c1-acd1-5b63666b0403 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.175937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c9e5-09e1-49c1-acd1-5b63666b0403 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.177510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1c9e5-09e1-49c1-acd1-5b63666b0403 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:38.177827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1c9e5-09e1-49c1-acd1-5b63666b0403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.179203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1c9e5-09e1-49c1-acd1-5b63666b0403 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.188421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 398/789] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:38.193883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07f3bb-c702-4e81-b518-5c048c7926d0 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.194258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07f3bb-c702-4e81-b518-5c048c7926d0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.194542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07f3bb-c702-4e81-b518-5c048c7926d0 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.196199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 399/790] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:38.196945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07f3bb-c702-4e81-b518-5c048c7926d0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.198170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660c96e-1c30-4aa2-ab09-d0bda76fb379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.201951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c96e-1c30-4aa2-ab09-d0bda76fb379 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.202225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c96e-1c30-4aa2-ab09-d0bda76fb379 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.202500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c96e-1c30-4aa2-ab09-d0bda76fb379 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.203296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660c96e-1c30-4aa2-ab09-d0bda76fb379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:38.203603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660c96e-1c30-4aa2-ab09-d0bda76fb379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.205026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660c96e-1c30-4aa2-ab09-d0bda76fb379 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.217618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 392/791] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:38.218878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d00a24-ae53-4ff3-bda7-3bcad2301b91 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.219161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d00a24-ae53-4ff3-bda7-3bcad2301b91 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.219435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d00a24-ae53-4ff3-bda7-3bcad2301b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.241348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-57d00a24-ae53-4ff3-bda7-3bcad2301b91 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:38.242713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-57d00a24-ae53-4ff3-bda7-3bcad2301b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:38.302962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07f3bb-c702-4e81-b518-5c048c7926d0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.309722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 393/792] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:38.310578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d00a24-ae53-4ff3-bda7-3bcad2301b91 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.346954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.347751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.348552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.348825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.359504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.360953 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:38.378575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:38.380674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:38.382869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:38.382869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:38.382869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:38.382869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:38.382869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 400/793] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:38.382869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.422729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d00a24-ae53-4ff3-bda7-3bcad2301b91 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.456761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.457634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.457912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.458184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.465653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.467096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:38.482307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:38.484609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:53:38.487028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:38.489167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71163b6-9d5c-4734-ac34-1aef92d924f9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.489707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 394/794] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:38.489707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.523276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.524072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.524354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.524628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.534940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:38.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:38.546262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 401/795] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:38.548260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.614788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1642aa-de4d-45ee-9cb7-f3ba97f366c4 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.661178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.662151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.662433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.662848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.663897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:38.664475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.665875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.666224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72568f-e482-46df-adba-ca73ced6aec4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.683098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 395/796] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:38.684005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.700390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.701110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.701394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.701695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.702529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:38.702836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.704352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.727761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 402/797] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:38.728654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.782615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c9a5a-670b-4c1a-a6b0-11b5c30b6a85 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.816745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.817413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.817715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.817983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.818709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:38.819011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.820360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.827563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889a78-5957-4185-9463-bcc5d28ddc65 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.828793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 396/798] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:38.829628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.867803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.868575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.868853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.869174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:38.876863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:38.878393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:38.893228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:38.896901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 403/799] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:38.899485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:38.935629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622e0bd-ff42-45c4-9e3d-504ecd81ef18 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:38.976705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:38.976705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:38.976705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:38.976705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.005259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019518-8a5d-4e5f-a70f-b3d570bf6f38 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.041809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.042598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.042962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.043140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.050441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.052079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.053697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.055534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:39.073205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:39.074258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:39.075220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:39.075220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:39.075220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:39.075220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:39.079161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 404/800] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:39.080003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.152993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 397/801] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:53:39.154088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.182785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7870ac-e46f-491f-9a3f-5e00f30c8f6b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.220029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.220726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.220994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.221263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.222126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:39.222431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.223885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.240492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 405/802] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:39.241367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.264796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec15182-a872-494b-aaa2-cd57afe9212d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.299300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b160c2-fc9d-400d-8ea0-2477c5631d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.299964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b160c2-fc9d-400d-8ea0-2477c5631d44 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.300248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b160c2-fc9d-400d-8ea0-2477c5631d44 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.300526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b160c2-fc9d-400d-8ea0-2477c5631d44 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.301822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b160c2-fc9d-400d-8ea0-2477c5631d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:39.302131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b160c2-fc9d-400d-8ea0-2477c5631d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.303531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b160c2-fc9d-400d-8ea0-2477c5631d44 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.315268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 398/803] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:39.320032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6a39d-c369-4f1d-8283-a239299c6771 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.320608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6a39d-c369-4f1d-8283-a239299c6771 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.320898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6a39d-c369-4f1d-8283-a239299c6771 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.323026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 399/804] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:39.326753 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6a39d-c369-4f1d-8283-a239299c6771 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.341761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b98a6-d9e5-4a5f-a33d-77801a18062d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.381248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.382068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.382341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.382896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.392393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.393975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:39.411802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:39.412712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:39.413640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:39.413640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:39.413640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:39.413640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:39.413640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 406/805] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:39.413912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.430908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6a39d-c369-4f1d-8283-a239299c6771 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.464767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a881ea-c0ca-4324-a71d-0d81a6f5ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.465596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a881ea-c0ca-4324-a71d-0d81a6f5ac80 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.465875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a881ea-c0ca-4324-a71d-0d81a6f5ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.466143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a881ea-c0ca-4324-a71d-0d81a6f5ac80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.475887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a881ea-c0ca-4324-a71d-0d81a6f5ac80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.477311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a881ea-c0ca-4324-a71d-0d81a6f5ac80 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-f6a881ea-c0ca-4324-a71d-0d81a6f5ac80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:39.495311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:39.496252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:39.497138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:39.497138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:39.497138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:39.497138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:39.497138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 400/806] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:39.497755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659a319-b3f4-4967-8f93-2962c4366f2a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.498036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659a319-b3f4-4967-8f93-2962c4366f2a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.498305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659a319-b3f4-4967-8f93-2962c4366f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.514971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3659a319-b3f4-4967-8f93-2962c4366f2a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:39.516145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3659a319-b3f4-4967-8f93-2962c4366f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:39.524034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a90b-9e2c-461e-a569-7aac7e6175b5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.558090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.558898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.559200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.559474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.566448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.568418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.589012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 401/807] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:39.589012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659a319-b3f4-4967-8f93-2962c4366f2a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:39.589309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:39.590220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 407/808] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:39.591226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.695539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fa4a-925b-4e4e-a5cb-4422d919912c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.700162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659a319-b3f4-4967-8f93-2962c4366f2a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.728469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.729122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.729398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.729696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.730406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:39.730708 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.732047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.735556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.736510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.736964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.737408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.738333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:39.738668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.740006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.747629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 408/809] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:39.747629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.758464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 402/810] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:39.758464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.841752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9858e-2096-4870-bd81-c8598713d71a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.855316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2b7b-1445-41e7-9ec3-a91f126e317f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:39.873630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.874483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.874943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.875221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.876050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:39.876367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.877802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.886768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:39.887569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:39.887853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:39.888128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:39.888769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:39.890141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:39.900154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 409/811] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:39.900154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:39.902699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:39.903594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:39.904428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 403/812] 10.222.0.69 () {56 vars in 1129 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:39.905261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.009266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3cf4e-c406-4d54-85cf-c75b1c20ba8b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.011671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb31ae-129e-43f5-949b-1e38da2d6f12 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.041990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.042808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.043086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.043358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.048240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.049234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.050003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.050452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.050558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.052508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.058699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.060318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:40.066259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:40.067701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:40.068573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 404/813] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:40.069489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:40.077069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:40.077998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:40.079142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 410/814] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:40.079616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.172071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52159-e150-4e34-81d8-4a6980c6030f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.172277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e522cae-2ac5-417c-83d5-0c853e8039fc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.205317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.205993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.206270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.206375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.206547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.207071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.207738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:40.207879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.208036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.208133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.209393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.214654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 411/815] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:40.215553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.220097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.221605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:40.241091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:40.242156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:40.243038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:40.243038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:40.243038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:40.243038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:40.243038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 405/816] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:40.243038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.314768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9e66-bdc2-47e5-af70-dd74ec080324 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.335268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce5c55-7c59-4c62-a437-bfa47e495ff3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.345720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e473-16ec-4f03-9f2c-bc78ed491e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.346363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e473-16ec-4f03-9f2c-bc78ed491e93 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.346634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e473-16ec-4f03-9f2c-bc78ed491e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.346901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e473-16ec-4f03-9f2c-bc78ed491e93 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.347667 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e473-16ec-4f03-9f2c-bc78ed491e93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:40.348528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e473-16ec-4f03-9f2c-bc78ed491e93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.349955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e473-16ec-4f03-9f2c-bc78ed491e93 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.361439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 412/817] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:40.362624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732e3c-12ff-4433-86a6-1ce63063e75e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.362905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732e3c-12ff-4433-86a6-1ce63063e75e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.363171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732e3c-12ff-4433-86a6-1ce63063e75e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.364539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 413/818] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:40.365143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92732e3c-12ff-4433-86a6-1ce63063e75e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.374705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.375358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.375632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.375899 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.376666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:40.376967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.378392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.389311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 406/819] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:40.390125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.460607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92732e3c-12ff-4433-86a6-1ce63063e75e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.482576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5211827-46f6-40cd-8629-f88ee1487edb None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.491692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.492590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.492993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.493387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.494471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:40.495006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.496934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.502077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 414/820] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:40.502846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.514548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c1d99-8279-42c4-861a-d21376c9d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.515220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c1d99-8279-42c4-861a-d21376c9d6af None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c1d99-8279-42c4-861a-d21376c9d6af None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.515777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c1d99-8279-42c4-861a-d21376c9d6af None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.516488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c1d99-8279-42c4-861a-d21376c9d6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:40.516799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c1d99-8279-42c4-861a-d21376c9d6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.518195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c1d99-8279-42c4-861a-d21376c9d6af None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.529994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 407/821] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:40.531167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb286-d011-44eb-b68a-af90a833da3f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.531460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb286-d011-44eb-b68a-af90a833da3f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.531791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb286-d011-44eb-b68a-af90a833da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.546999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4bbdb286-d011-44eb-b68a-af90a833da3f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:40.548176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4bbdb286-d011-44eb-b68a-af90a833da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:40.595137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a6fc2-ab5a-4f9a-ba7f-41bc09e69338 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.609761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 408/822] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:40.610546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdb286-d011-44eb-b68a-af90a833da3f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.630655 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.631294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.631645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.631912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.632718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=ea420049f83643a19cb6c1d0a36fc8bc) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:40.633022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.634446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.640122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 415/823] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/role_assignments?user.id=ea420049f83643a19cb6c1d0a36fc8bc&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:40.640939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.715386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdb286-d011-44eb-b68a-af90a833da3f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.743712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cb01-80ea-4563-90dc-98de5238a72d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.759066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.759963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.760237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.760504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/0e9763d8a5c040ce876a787bed7fc954/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.762543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=0e9763d8a5c040ce876a787bed7fc954, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.764115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.779452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.780122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:40.780400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:40.780694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:40.781454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:40.782927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:40.785566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 409/824] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:40 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/0e9763d8a5c040ce876a787bed7fc954/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:40.786954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.814136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 416/825] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:53:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:40.815243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:40.937501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e228d-375d-4623-8ec0-840dc05fff5d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.969369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254fafc-6786-4d5a-9bc4-8c5976c1ebf9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:40.998325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:40.999525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:41.000075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:41.001815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:41.011975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:41.014209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:41.016479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:41.017296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:41.017607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:41.017878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:41.018539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:41.020221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:41.033164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:41.034257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:53:41.035111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:41.035923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 417/826] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:41.040607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:41.041548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:41.042422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:41.042852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:41.045008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 410/827] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:41.051423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:41.159082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1955f7-5f4b-46cb-a45d-b6cc8500d32b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:41.165386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80f07e-7c87-4105-87e1-39328338a7e0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:41.199367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:41.200421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:41.201102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:41.201911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:41.203218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:41.203775 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:41.205762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:41.206681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:41.207496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:41.207863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:41.208228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:41.209039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] RBAC: Adding query filter params (name=network) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:41.209552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:41.210903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:41.220030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 418/828] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:41.221112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 411/829] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:41.221401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:41.230362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:41.323666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367a26-dce1-431e-b2f8-f6af20469c61 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:41.334414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823711d-0a5d-4993-8b7a-33f7fd5309c9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:41.357731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:41.358389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:41.358666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:41.358932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:41.359628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:41.359925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:41.361268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:41.371250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 419/830] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:41.372466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:41.373757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be117a89-706c-4955-90b0-a8e56c2dfaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:41.374890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be117a89-706c-4955-90b0-a8e56c2dfaf5 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:41.375401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be117a89-706c-4955-90b0-a8e56c2dfaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:41.375876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be117a89-706c-4955-90b0-a8e56c2dfaf5 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/3c6b49d2b3904ceca7db22423b2e7a7e/roles/2a60ba556fb14d54b12b57808444fca0` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:41.391076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be117a89-706c-4955-90b0-a8e56c2dfaf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=3c6b49d2b3904ceca7db22423b2e7a7e, role_id=2a60ba556fb14d54b12b57808444fca0)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:41.392805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be117a89-706c-4955-90b0-a8e56c2dfaf5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:41.408334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 412/831] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:41 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/3c6b49d2b3904ceca7db22423b2e7a7e/roles/2a60ba556fb14d54b12b57808444fca0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:41.475430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68581-ed49-475a-b877-6c258ad580c1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:41.509589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f961a3-76d4-4e8b-9f90-04cba8a9d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:41.510265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f961a3-76d4-4e8b-9f90-04cba8a9d9b9 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:41.510685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f961a3-76d4-4e8b-9f90-04cba8a9d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:41.511157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f961a3-76d4-4e8b-9f90-04cba8a9d9b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:41.512382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f961a3-76d4-4e8b-9f90-04cba8a9d9b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:41.513835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f961a3-76d4-4e8b-9f90-04cba8a9d9b9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:41.545484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 420/832] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:53:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:43.261948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816509e2-237f-4209-a0d6-97c65e339c5b None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.262942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816509e2-237f-4209-a0d6-97c65e339c5b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.263428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816509e2-237f-4209-a0d6-97c65e339c5b None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.265267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 413/833] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:43.270816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf69a5-dde4-409f-9c6f-b2abafbab4b2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.271211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf69a5-dde4-409f-9c6f-b2abafbab4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.271399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf69a5-dde4-409f-9c6f-b2abafbab4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.288577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-97cf69a5-dde4-409f-9c6f-b2abafbab4b2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:43.289783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-97cf69a5-dde4-409f-9c6f-b2abafbab4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:43.370774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02dc0-9230-469a-abe4-6456bc4d15b7 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.370970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 421/834] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:43.371077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02dc0-9230-469a-abe4-6456bc4d15b7 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.371327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02dc0-9230-469a-abe4-6456bc4d15b7 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.372980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 414/835] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:53:43.378086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5d6c0-1165-424d-9b33-a2619120aa62 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.378374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5d6c0-1165-424d-9b33-a2619120aa62 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.378650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5d6c0-1165-424d-9b33-a2619120aa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.395789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc02dc0-9230-469a-abe4-6456bc4d15b7 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:43.395992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a9e5d6c0-1165-424d-9b33-a2619120aa62 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:43.396961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a9e5d6c0-1165-424d-9b33-a2619120aa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:43.466589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 422/836] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:43.487670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5d6c0-1165-424d-9b33-a2619120aa62 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:43.518897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc02dc0-9230-469a-abe4-6456bc4d15b7 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:43.552535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bb498-84f1-4188-a05b-0643e8998f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:43.553330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb498-84f1-4188-a05b-0643e8998f46 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.553650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb498-84f1-4188-a05b-0643e8998f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.553920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb498-84f1-4188-a05b-0643e8998f46 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.554586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bb498-84f1-4188-a05b-0643e8998f46 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:43.555917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bb498-84f1-4188-a05b-0643e8998f46 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-f99bb498-84f1-4188-a05b-0643e8998f46 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:43.567854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:43.569048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:43.569905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 415/837] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:43.570692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085a51-d6bc-4bb0-ba90-e5cc60994df7 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.570692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085a51-d6bc-4bb0-ba90-e5cc60994df7 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.570830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085a51-d6bc-4bb0-ba90-e5cc60994df7 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.575990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 416/838] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:43.576649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18085a51-d6bc-4bb0-ba90-e5cc60994df7 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:43.590954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5d6c0-1165-424d-9b33-a2619120aa62 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:43.623346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225439-8cbb-48c8-9363-8139b896c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:43.624150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225439-8cbb-48c8-9363-8139b896c14d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.624429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225439-8cbb-48c8-9363-8139b896c14d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.624698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225439-8cbb-48c8-9363-8139b896c14d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.625343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225439-8cbb-48c8-9363-8139b896c14d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:43.626723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225439-8cbb-48c8-9363-8139b896c14d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-14225439-8cbb-48c8-9363-8139b896c14d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:43.639307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:43.640217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:43.641044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 423/839] 10.222.0.69 () {56 vars in 1132 bytes} [Wed May 4 18:53:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:43.642367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c260be-11eb-4fe7-8616-90ce6c3c67e4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.642367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c260be-11eb-4fe7-8616-90ce6c3c67e4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.642506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c260be-11eb-4fe7-8616-90ce6c3c67e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.658973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a2c260be-11eb-4fe7-8616-90ce6c3c67e4 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:43.660161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a2c260be-11eb-4fe7-8616-90ce6c3c67e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:43.680171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18085a51-d6bc-4bb0-ba90-e5cc60994df7 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:43.716417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:43.717086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.717368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.717670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.718370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:43.718677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:43.720038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:43.728930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 417/840] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:43.728930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:43.733773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 424/841] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:43.741515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c260be-11eb-4fe7-8616-90ce6c3c67e4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:43.835198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c260be-11eb-4fe7-8616-90ce6c3c67e4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:43.840373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab8718-c3a0-4c3c-8821-9050492e4e48 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:43.868249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:43.869010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.869287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.869593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.870292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:43.870599 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:43.871965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:43.876175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:43.876394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 425/842] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:43.877152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:43.877455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:43.877935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:43.878210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:43.878980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:43.879777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:43.881164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:43.890875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 418/843] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:43.897021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:43.997985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e24e1a-d759-4074-88ed-ce68f007bfc6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.027719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77364de8-efe2-4992-ba2b-c99cd79d8b4a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.033298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f85fd-e349-4869-b392-c21917b8ee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.034136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f85fd-e349-4869-b392-c21917b8ee73 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.034416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f85fd-e349-4869-b392-c21917b8ee73 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.034873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f85fd-e349-4869-b392-c21917b8ee73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.046331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f85fd-e349-4869-b392-c21917b8ee73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bc9f85fd-e349-4869-b392-c21917b8ee73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:44.054945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:44.056114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:44.057008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 426/844] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:44.058171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eacf2-dc7f-4873-9d88-78f274bb48f3 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.058171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eacf2-dc7f-4873-9d88-78f274bb48f3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.058171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eacf2-dc7f-4873-9d88-78f274bb48f3 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.063329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 427/845] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:44.063329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eacf2-dc7f-4873-9d88-78f274bb48f3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.070620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68ba6-ec81-4a05-9501-7a22d0781aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.071322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68ba6-ec81-4a05-9501-7a22d0781aec None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.071600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68ba6-ec81-4a05-9501-7a22d0781aec None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.071874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68ba6-ec81-4a05-9501-7a22d0781aec None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.072577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68ba6-ec81-4a05-9501-7a22d0781aec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:44.072882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68ba6-ec81-4a05-9501-7a22d0781aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.074287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68ba6-ec81-4a05-9501-7a22d0781aec None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.079825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 419/846] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:44.081056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a50ab-e446-4acc-a5bc-4ddf83a7f428 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.081341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a50ab-e446-4acc-a5bc-4ddf83a7f428 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.081650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a50ab-e446-4acc-a5bc-4ddf83a7f428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.099487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c08a50ab-e446-4acc-a5bc-4ddf83a7f428 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:44.101091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c08a50ab-e446-4acc-a5bc-4ddf83a7f428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:44.185766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eacf2-dc7f-4873-9d88-78f274bb48f3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.193641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 420/847] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:44.226507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a50ab-e446-4acc-a5bc-4ddf83a7f428 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.227371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852930-6343-4277-b517-566e7d94575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.228258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852930-6343-4277-b517-566e7d94575d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.228746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852930-6343-4277-b517-566e7d94575d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.229257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852930-6343-4277-b517-566e7d94575d None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.230274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852930-6343-4277-b517-566e7d94575d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:44.230768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852930-6343-4277-b517-566e7d94575d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.232345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852930-6343-4277-b517-566e7d94575d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.243887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 428/848] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:44.249774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852930-6343-4277-b517-566e7d94575d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.334342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a50ab-e446-4acc-a5bc-4ddf83a7f428 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.357975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852930-6343-4277-b517-566e7d94575d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.370419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.371490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.371949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.372404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.382759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:44.390683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:44.391602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:53:44.392439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:44.393086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.393086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.393086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.393086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.395764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 421/849] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:44.401718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.408566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.410658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:44.428965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:44.429942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:44.430852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:44.430852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:44.430852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:44.430852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:44.434909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 429/850] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:44.436316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.522728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069e2a5-4d01-490e-8ac8-a377f255ccae None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.548516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3e2b7-66c2-47d9-bd5a-e9d4db8e92ea None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.556844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.557718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.558182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.558620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.559494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:44.559945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.561438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.573568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 422/851] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:44.575590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.586866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.588006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.588390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.588765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.589938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:44.590367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.592113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.611981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 430/852] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:44.613693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.690058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afef9df-cd07-4227-8dfb-61f05711c605 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.713213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa779d4-d7f4-456a-af99-ce076a5ca64d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.724699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.725645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.726126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.726424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.746218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.747690 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.749221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.750281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.750844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.751388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.759666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.761340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:44.766467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:44.767369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:44.773830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:44.773830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:44.773830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:44.773830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:44.773830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 423/853] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:44.775518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:44.782252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:44.783202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:53:44.784785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:44.788693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 431/854] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:44.789727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.896679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667656fb-146f-4788-b25a-d121a9087b95 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.904698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3c02-9226-49ba-ad63-76493eb0e0e9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:44.931936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.932724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.933100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.933498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.934439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:44.935121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.936589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.947946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:44.948813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:44.949247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:44.949727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:44.950593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:44.951049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:44.953082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:44.960072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 432/855] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:44.961256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:44.981841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 424/856] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:44.983223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.083009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d537dd-99fe-4af5-b842-5d14b28d757c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.094113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d7958-1d92-4a30-beb3-a1858be4c849 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.122383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.123974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.124416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.124976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.130739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.131487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.131862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.132228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.133642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.135423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:45.154950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:45.156124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:45.157292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:45.159989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 425/857] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:45.166521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.209198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.210756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.295396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa59c47-d6c1-4096-8428-17731de825db None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.316688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 433/858] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:53:45.317765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.341908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.343770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.344290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.344930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.346578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:45.347122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.350138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.371710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 426/859] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:45.377706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.422369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ce1c2-dfac-405f-9b10-7bf5a30f19ec None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.455791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.456590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.456873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.457700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.469269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.470754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:45.488781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:45.489741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:45.490622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:45.490622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:45.490622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:45.490622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:45.490622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 434/860] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:45.495685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.503246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbf4f7-3c90-4c80-8dfd-ca74b09ab79b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.544929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.545626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.545909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.546184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.615893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49f1f-9c40-4405-a981-061712195f78 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.626191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.628020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.651035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.651788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.651972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.652239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.652954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:45.653258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.654651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.671124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 435/861] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:45.673932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.735944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 427/862] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:53:45.744244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.792259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000a413-9181-4697-a2b9-08a6d5310c8c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.831536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.832909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.833189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.833473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.840772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.842249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:45.856610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:45.857567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:45.858457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:45.861571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 436/863] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:45.863903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.865007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef45e-9c2f-41b7-b8c5-df1a314c9ad8 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:45.900739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:45.902021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:45.902524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:45.903021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:45.913927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:45.915743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:45.934105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:45.935037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:45.935928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:45.935928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:45.935928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:45.935928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:45.938271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 428/864] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:45.946439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:45.980360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427e6ff-bb2a-4067-a220-f79c583780b1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.017943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.018733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.019112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.020316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.021259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:46.021706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.023314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.041998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 437/865] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:46.043419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:46.062782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b534170-3856-475e-ab46-0c1cf01450b1 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.097507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.098546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.099011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.099471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.100371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:46.100854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.102472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.114976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 429/866] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:46.122446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:46.155733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435aaee-a536-4e9c-8286-990ebca9cae8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.203601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd8c43-e43a-4ac9-b1c5-923a73695dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.204533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd8c43-e43a-4ac9-b1c5-923a73695dd7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.204974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd8c43-e43a-4ac9-b1c5-923a73695dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.205249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd8c43-e43a-4ac9-b1c5-923a73695dd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.206147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd8c43-e43a-4ac9-b1c5-923a73695dd7 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=0e9763d8a5c040ce876a787bed7fc954) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:46.206458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd8c43-e43a-4ac9-b1c5-923a73695dd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.208057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd8c43-e43a-4ac9-b1c5-923a73695dd7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.218523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 438/867] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:46 2022] GET /identity/v3/role_assignments?user.id=0e9763d8a5c040ce876a787bed7fc954&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:46.218523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfe5a2-e60c-4acc-aeb1-190a020d876c None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.218523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfe5a2-e60c-4acc-aeb1-190a020d876c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.218523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfe5a2-e60c-4acc-aeb1-190a020d876c None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.221635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 439/868] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:46.223090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd579-024c-4f94-bdd0-5cc8e6114359 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.223374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd579-024c-4f94-bdd0-5cc8e6114359 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.223649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd579-024c-4f94-bdd0-5cc8e6114359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.244397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a6efd579-024c-4f94-bdd0-5cc8e6114359 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:46.247465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0af9-a13b-489b-b7f1-bdd705be1592 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.249643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a6efd579-024c-4f94-bdd0-5cc8e6114359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:46.287829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.288703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.288990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.289266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.297292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.298807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:46.315902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:46.317506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:46.318395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 430/869] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:46.323758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:46.346568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 440/870] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:46.368446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda7f2-b7cc-452b-99c3-de8b2e124082 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.368761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda7f2-b7cc-452b-99c3-de8b2e124082 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.368991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda7f2-b7cc-452b-99c3-de8b2e124082 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.370572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 441/871] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:53:46.375222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda7f2-b7cc-452b-99c3-de8b2e124082 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:46.444380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e268ccf-9b8b-4574-8cb5-d89e7c2ad217 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.479668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda7f2-b7cc-452b-99c3-de8b2e124082 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.481728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3de867-5eb1-467b-acf1-2f6298104455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.482392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de867-5eb1-467b-acf1-2f6298104455 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.482673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de867-5eb1-467b-acf1-2f6298104455 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.482946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de867-5eb1-467b-acf1-2f6298104455 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.483722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3de867-5eb1-467b-acf1-2f6298104455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:46.484028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3de867-5eb1-467b-acf1-2f6298104455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.485440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3de867-5eb1-467b-acf1-2f6298104455 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.497674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 431/872] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:46.498909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86256f2-709f-415d-998b-cea126244b85 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.499192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86256f2-709f-415d-998b-cea126244b85 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.499461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86256f2-709f-415d-998b-cea126244b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.514969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c86256f2-709f-415d-998b-cea126244b85 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:46.516115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c86256f2-709f-415d-998b-cea126244b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:46.519366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.520273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.520550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.520819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.521573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.522926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.537068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 442/873] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:53:46 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:46.537902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:46.617800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 432/874] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:46.639930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86256f2-709f-415d-998b-cea126244b85 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:46.669258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563aa55-27e0-4197-9ce0-5917d63a00cd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.716785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260d316-f662-4b12-84bc-96a1878faf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.717880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260d316-f662-4b12-84bc-96a1878faf0d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.718507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260d316-f662-4b12-84bc-96a1878faf0d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.718791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260d316-f662-4b12-84bc-96a1878faf0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.719628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260d316-f662-4b12-84bc-96a1878faf0d None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=3c6b49d2b3904ceca7db22423b2e7a7e) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:46.719933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260d316-f662-4b12-84bc-96a1878faf0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.722237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260d316-f662-4b12-84bc-96a1878faf0d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.733242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 443/875] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:46 2022] GET /identity/v3/role_assignments?user.id=3c6b49d2b3904ceca7db22423b2e7a7e&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:46.766760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86256f2-709f-415d-998b-cea126244b85 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:46.811346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95796b-b012-43e8-928c-dde35e9592f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:46.812481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95796b-b012-43e8-928c-dde35e9592f1 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:46.812965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95796b-b012-43e8-928c-dde35e9592f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:46.813523 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95796b-b012-43e8-928c-dde35e9592f1 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:46.814492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95796b-b012-43e8-928c-dde35e9592f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:46.816110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95796b-b012-43e8-928c-dde35e9592f1 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:46.833621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 433/876] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:53:46 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:53:48.541526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458425b0-dcd1-4393-9a61-9e031eb890e1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:48.542087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458425b0-dcd1-4393-9a61-9e031eb890e1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:48.542087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458425b0-dcd1-4393-9a61-9e031eb890e1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:48.543702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 444/877] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:48.549013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38cfc-175b-48df-b9d2-601dfd884029 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:48.549421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38cfc-175b-48df-b9d2-601dfd884029 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:48.549623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38cfc-175b-48df-b9d2-601dfd884029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:48.566129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-67f38cfc-175b-48df-b9d2-601dfd884029 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:48.567353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-67f38cfc-175b-48df-b9d2-601dfd884029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:48.638588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 434/878] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:48.661328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458425b0-dcd1-4393-9a61-9e031eb890e1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:48.767760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458425b0-dcd1-4393-9a61-9e031eb890e1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:48.802024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0539f-f28f-4f58-bc20-4081b591acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:48.802837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0539f-f28f-4f58-bc20-4081b591acc7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:48.803116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0539f-f28f-4f58-bc20-4081b591acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:48.803389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0539f-f28f-4f58-bc20-4081b591acc7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:48.804035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0539f-f28f-4f58-bc20-4081b591acc7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:48.805392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0539f-f28f-4f58-bc20-4081b591acc7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bdc0539f-f28f-4f58-bc20-4081b591acc7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:48.817899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:48.818902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:48.820823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 445/879] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:48.825211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38cfc-175b-48df-b9d2-601dfd884029 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:48.909387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904d39d-51a2-4b00-9b4e-56709aed88a1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:48.909739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904d39d-51a2-4b00-9b4e-56709aed88a1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:48.909992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904d39d-51a2-4b00-9b4e-56709aed88a1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:48.912275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 446/880] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:53:48.918380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b969-fd08-4271-8239-10f824e555b2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:48.918926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b969-fd08-4271-8239-10f824e555b2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:48.919378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b969-fd08-4271-8239-10f824e555b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:48.936063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38cfc-175b-48df-b9d2-601dfd884029 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:48.940360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5e83b969-fd08-4271-8239-10f824e555b2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:48.942198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5e83b969-fd08-4271-8239-10f824e555b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:48.984413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:48.985388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:48.985839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:48.986249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:48.987113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:48.987566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:48.989195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:48.995033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 435/881] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:53:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:49.000732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.028237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 447/882] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:49.053816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83b969-fd08-4271-8239-10f824e555b2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.118570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc853-b42f-4ea3-9fb9-311a5f373b07 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.152562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456fdfb-6a70-4a4e-ad7e-34702db0b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.153718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456fdfb-6a70-4a4e-ad7e-34702db0b02f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.154012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456fdfb-6a70-4a4e-ad7e-34702db0b02f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.154443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456fdfb-6a70-4a4e-ad7e-34702db0b02f None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.155184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456fdfb-6a70-4a4e-ad7e-34702db0b02f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:49.155492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456fdfb-6a70-4a4e-ad7e-34702db0b02f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.156503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83b969-fd08-4271-8239-10f824e555b2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.156852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456fdfb-6a70-4a4e-ad7e-34702db0b02f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.162980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 436/883] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:53:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:49.162980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dfbe6-6abb-4d1b-bad1-cc3526671c19 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.162980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dfbe6-6abb-4d1b-bad1-cc3526671c19 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.163301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dfbe6-6abb-4d1b-bad1-cc3526671c19 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.164790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 437/884] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:49.165970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa574-bf72-42ce-9dd6-a41b7f539451 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.166255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa574-bf72-42ce-9dd6-a41b7f539451 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.166532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa574-bf72-42ce-9dd6-a41b7f539451 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.168161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 438/885] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:49.173032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb960-22e3-4f22-a22c-205bfaa1ac6d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.173032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb960-22e3-4f22-a22c-205bfaa1ac6d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.173032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb960-22e3-4f22-a22c-205bfaa1ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.188723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b2dfb960-22e3-4f22-a22c-205bfaa1ac6d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:49.190003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b2dfb960-22e3-4f22-a22c-205bfaa1ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:49.196625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895de975-0876-477a-b171-ab3c1204894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.197740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895de975-0876-477a-b171-ab3c1204894b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.198167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895de975-0876-477a-b171-ab3c1204894b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.198627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895de975-0876-477a-b171-ab3c1204894b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.199304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895de975-0876-477a-b171-ab3c1204894b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.200716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895de975-0876-477a-b171-ab3c1204894b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-895de975-0876-477a-b171-ab3c1204894b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:49.213003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:49.214159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:49.215008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 448/886] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:49.215813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1e283-ea7c-4e13-8cb6-325efc24416d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.216425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1e283-ea7c-4e13-8cb6-325efc24416d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.216425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1e283-ea7c-4e13-8cb6-325efc24416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.234801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e7d1e283-ea7c-4e13-8cb6-325efc24416d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:49.236017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e7d1e283-ea7c-4e13-8cb6-325efc24416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:49.268067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 439/887] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:53:49.268949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb960-22e3-4f22-a22c-205bfaa1ac6d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.323945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 449/888] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:49.324737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1e283-ea7c-4e13-8cb6-325efc24416d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.387579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb960-22e3-4f22-a22c-205bfaa1ac6d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.421646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.422403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.422688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.422964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.423660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:49.423959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.425312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.430704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 440/889] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:49.431401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.433636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1e283-ea7c-4e13-8cb6-325efc24416d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.467575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.468386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.468664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.468927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.479773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:49.487858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:49.489789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 450/890] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:49.490618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.538266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7dda-0ab3-4799-84e2-c69e42e8cd49 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.571148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.571961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.572240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.572508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.573145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.574606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.586205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcaf21-aee2-4231-aa2a-fd3350ac345a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:49.586669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:49.587556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:49.593279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 441/891] 10.222.0.69 () {56 vars in 1132 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:49.594150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.620200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.620863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.621143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.621419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.622197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:49.622505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.623861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.628556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 451/892] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:49.633885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.688789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5ec1-cd13-4820-82b7-fa1d06709ea4 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.720715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.721379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.721681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.721952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.723199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:49.723509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.724861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.728930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3261c7-c600-4ede-aec5-587fafe95a00 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.737024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 442/893] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:49.737024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.762219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.762875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.763162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.763445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.764142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:49.764447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.765834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.771279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 452/894] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:49.776601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.834828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84208-fab0-4fd8-a69f-a353d68a43de None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.867040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.867863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.868211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.868489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.869263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] RBAC: Adding query filter params (interface=public, service_id=e6091f83299e4878b48f443b1caeff64, region_id=RegionOne) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:49.869608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.870962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.875682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c1b9-f5e8-4ad7-b784-73cb32831384 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:49.878081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 443/895] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/endpoints?service_id=e6091f83299e4878b48f443b1caeff64&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:49.878894 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.912914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:49.913748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:49.914029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:49.914300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:49.924981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:49.926482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:49.942851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:49.943761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:49.944658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:49.944658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:49.944658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:49.944658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:49.944658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 453/896] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:49.944969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:49.981205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4097-b9f1-42b6-9c41-11bb7ce4e96e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.014461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.015126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.015405 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.015677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.016374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:50.016678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.018060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.024397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 444/897] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:50.025179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:50.056259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633b509-d36e-497f-bd24-b77770328d07 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.088924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.089533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.089812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.090089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.090765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.092119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.109529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 454/898] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:53:49 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:53:50.109529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:50.150917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ca2-7b83-4620-98ab-0c91e271f8ca None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.187774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.188457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.188736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.189009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.189781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:50.190086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.192020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.210393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 445/899] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:50.211731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:50.216213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757cb2f-0181-44be-86f5-281bfe7e4b8a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.256143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.256812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.257093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.257371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.258371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] RBAC: Adding query filter params (interface=public, service_id=ce4922da51c84ab98762297b9acdfc06, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:50.258679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.260074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.266036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 455/900] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:53:50 2022] GET /identity/v3/endpoints?service_id=ce4922da51c84ab98762297b9acdfc06&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:50.272547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:50.346115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf053-922d-4918-bc68-09be2ca053d6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.387407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.388801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.389336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.389815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.400104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.402496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.404142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092f1a0-3d46-4ee2-b1e4-59da6d13094d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:50.421345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:50.422323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:50.423256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 446/901] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:53:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:50.428630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:50.443148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.444108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.444657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.444938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.445651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.447285 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.454699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 456/902] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:53:50 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:53:50.544993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fdf2e-e78d-4795-91a0-02fc47a1b995 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.582782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.584233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.584666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.585099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.586208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:50.586668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.588274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.608142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 447/903] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 18:53:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:50.614048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:50.716778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f237-0f00-4690-83f2-6c0f549053cf None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:50.750030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:50.750676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:50.750956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:50.751227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:50.819532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:50.820985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:50.925369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 457/904] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:53:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:53:50.927305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:51.038280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd875a6-31d9-426f-b981-1f75ed87bf75 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:51.072943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:51.073768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.074051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.074326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.084375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:51.085836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:51.105339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:51.106436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:51.107800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:51.107800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:51.107800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:51.107800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:51.107800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 448/905] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:51.114539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:51.214032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f82b6-e524-439f-b977-f92ce9877ef6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:51.251487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca2894-2eec-4061-9bff-366dcee9beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:51.252592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2894-2eec-4061-9bff-366dcee9beaf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.253105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2894-2eec-4061-9bff-366dcee9beaf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.253689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2894-2eec-4061-9bff-366dcee9beaf None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.254652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2894-2eec-4061-9bff-366dcee9beaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:51.255176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2894-2eec-4061-9bff-366dcee9beaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:51.256793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2894-2eec-4061-9bff-366dcee9beaf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:51.275134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 458/906] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:51.276806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:51.383350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a2140-b2b2-4e4a-9701-c48b469d5e2f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:51.417319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:51.418198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.418474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.418744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.425271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:51.426828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:51.429437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab780-0632-41b6-83be-33d639142ecf None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.429768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab780-0632-41b6-83be-33d639142ecf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.430046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab780-0632-41b6-83be-33d639142ecf None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.431630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 459/907] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:53:51.436584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b81a-d2d6-4bf3-982e-62fe15b12b4b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.436872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b81a-d2d6-4bf3-982e-62fe15b12b4b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.437152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b81a-d2d6-4bf3-982e-62fe15b12b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:51.441151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:51.442086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:51.442972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 449/908] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:51.448761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:51.453486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a518b81a-d2d6-4bf3-982e-62fe15b12b4b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:51.454659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a518b81a-d2d6-4bf3-982e-62fe15b12b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:51.525300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 460/909] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:51.547548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518b81a-d2d6-4bf3-982e-62fe15b12b4b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:51.566249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b84e3-aac9-4871-a742-77df52b71c32 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:51.605090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:51.605772 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.606043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.606749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.607820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:51.608134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:51.610080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:51.627912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 450/910] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:51.629198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:51.660985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518b81a-d2d6-4bf3-982e-62fe15b12b4b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:51.699114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2289d4-32b7-4f80-b849-7bf77878216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:51.699785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2289d4-32b7-4f80-b849-7bf77878216e None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.700066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2289d4-32b7-4f80-b849-7bf77878216e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.700340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2289d4-32b7-4f80-b849-7bf77878216e None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.701068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2289d4-32b7-4f80-b849-7bf77878216e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:51.702476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2289d4-32b7-4f80-b849-7bf77878216e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:51.721561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 461/911] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:53:51 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:53:51.739887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5de62c-f71b-4cc4-9b00-5b7a075b2421 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:51.782476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e7abf-43f4-44d4-90ba-865ec9cc4d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:51.783196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7abf-43f4-44d4-90ba-865ec9cc4d99 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:51.783525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7abf-43f4-44d4-90ba-865ec9cc4d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:51.783839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7abf-43f4-44d4-90ba-865ec9cc4d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:51.784669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e7abf-43f4-44d4-90ba-865ec9cc4d99 None admin] RBAC: Adding query filter params (role.id=3b3778712e12487398645999425ac101, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=3c6b49d2b3904ceca7db22423b2e7a7e) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:51.785530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e7abf-43f4-44d4-90ba-865ec9cc4d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:51.786983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e7abf-43f4-44d4-90ba-865ec9cc4d99 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:51.793647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 451/912] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:53:51 2022] GET /identity/v3/role_assignments?user.id=3c6b49d2b3904ceca7db22423b2e7a7e&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=3b3778712e12487398645999425ac101 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:52.484177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376971ed-cefb-48e8-9edd-bdd976ee56bc None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:52.484599 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376971ed-cefb-48e8-9edd-bdd976ee56bc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:52.484796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376971ed-cefb-48e8-9edd-bdd976ee56bc None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:52.486391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 462/913] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:52.491704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9fed-1f2e-4dfa-bbd2-bc3aa5ece6bd None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:52.491996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9fed-1f2e-4dfa-bbd2-bc3aa5ece6bd None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:52.492273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9fed-1f2e-4dfa-bbd2-bc3aa5ece6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:52.509495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8e7e9fed-1f2e-4dfa-bbd2-bc3aa5ece6bd None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:52.510689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8e7e9fed-1f2e-4dfa-bbd2-bc3aa5ece6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:52.578312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 452/914] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:52.601240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376971ed-cefb-48e8-9edd-bdd976ee56bc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:52.708653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376971ed-cefb-48e8-9edd-bdd976ee56bc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:52.742192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad57b1f-318b-4285-a29f-51a0a5ad7336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:52.742912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad57b1f-318b-4285-a29f-51a0a5ad7336 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:52.743190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad57b1f-318b-4285-a29f-51a0a5ad7336 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:52.743462 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad57b1f-318b-4285-a29f-51a0a5ad7336 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:52.744108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad57b1f-318b-4285-a29f-51a0a5ad7336 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:52.745475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad57b1f-318b-4285-a29f-51a0a5ad7336 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-dad57b1f-318b-4285-a29f-51a0a5ad7336 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:52.757946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:52.760279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:52.762338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 463/915] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:52.765493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9fed-1f2e-4dfa-bbd2-bc3aa5ece6bd None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:52.825635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3557-881e-4012-8496-52d98e8561b4 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:52.825635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3557-881e-4012-8496-52d98e8561b4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:52.825635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3557-881e-4012-8496-52d98e8561b4 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:52.826504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 464/916] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:52.831850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6083ed-883d-48d3-bae2-86f64d025366 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:52.832413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6083ed-883d-48d3-bae2-86f64d025366 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:52.832910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6083ed-883d-48d3-bae2-86f64d025366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:52.849563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8e6083ed-883d-48d3-bae2-86f64d025366 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:52.851072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8e6083ed-883d-48d3-bae2-86f64d025366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:52.876559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9fed-1f2e-4dfa-bbd2-bc3aa5ece6bd None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:52.913955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:52.915114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:52.915612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:52.916110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:52.917077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:52.917686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:52.919451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:52.926549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 453/917] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:52.932516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:52.940108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 465/918] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:53:52.963881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6083ed-883d-48d3-bae2-86f64d025366 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:53.046419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62781abd-8603-483a-8ae5-17c79253281a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:53.087076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:53.087707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6083ed-883d-48d3-bae2-86f64d025366 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:53.087829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:53.088020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:53.088301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:53.088989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:53.089293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:53.090883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:53.101621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 454/919] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 18:53:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:53.103708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:53.126053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:53.127145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:53.127633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:53.128132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:53.129069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:53.130677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:53.143876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:53.145650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:53:53.146494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:53.153639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 466/920] 10.222.0.69 () {56 vars in 1132 bytes} [Wed May 4 18:53:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:53.155453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:53.222979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6dbcb-e03f-496d-8702-d56b1baf18b6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:53.261000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33166a-cfcd-4980-98e3-1d34dc88e7c6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:53.264709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:53.265379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:53.265688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:53.265963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:53.266707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:53.268075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:53.296352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 455/921] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:53:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:53:53.316781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:53.317889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:53.318866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:53.318866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:53.319855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:53.320424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:53.322267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:53.328885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 467/922] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:53.336245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:53.458662 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edeb7d-1607-4bbb-b1ef-aa32e29e61e0 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:53.499132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaab7a-1c14-4659-98a4-cc66e0326ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:53.499528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaab7a-1c14-4659-98a4-cc66e0326ab0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:53.499737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaab7a-1c14-4659-98a4-cc66e0326ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:53.499994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaab7a-1c14-4659-98a4-cc66e0326ab0 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:53.500768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaab7a-1c14-4659-98a4-cc66e0326ab0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:53.501030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaab7a-1c14-4659-98a4-cc66e0326ab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:53.502459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaab7a-1c14-4659-98a4-cc66e0326ab0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:53.509423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 456/923] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:53.515070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:53.622983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb67049-9494-48d7-8390-4ec604af01a5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:53.658334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f164d-0528-404c-94a0-ee9bd8e7aad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:53.659403 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f164d-0528-404c-94a0-ee9bd8e7aad8 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:53.659926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f164d-0528-404c-94a0-ee9bd8e7aad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:53.660438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f164d-0528-404c-94a0-ee9bd8e7aad8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:53.661378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f164d-0528-404c-94a0-ee9bd8e7aad8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:53.662994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f164d-0528-404c-94a0-ee9bd8e7aad8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:53.685178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 468/924] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:53:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:54.086154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23683-b004-4bd3-b0c5-02747a7fa703 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.086691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23683-b004-4bd3-b0c5-02747a7fa703 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.086691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23683-b004-4bd3-b0c5-02747a7fa703 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.088322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 457/925] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:54.094036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00eab3-ca00-4467-b4ac-fd3fe4fe96b3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.094462 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00eab3-ca00-4467-b4ac-fd3fe4fe96b3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.094641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00eab3-ca00-4467-b4ac-fd3fe4fe96b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.097865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbd3a5-98c7-4938-bcea-38b81f1b1223 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.098154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbd3a5-98c7-4938-bcea-38b81f1b1223 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.098430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbd3a5-98c7-4938-bcea-38b81f1b1223 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.100046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 458/926] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:54.104946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e6ed-4860-4fbb-be31-138c8bfc5250 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.105235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e6ed-4860-4fbb-be31-138c8bfc5250 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.105539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e6ed-4860-4fbb-be31-138c8bfc5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.114165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9e00eab3-ca00-4467-b4ac-fd3fe4fe96b3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:54.115657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9e00eab3-ca00-4467-b4ac-fd3fe4fe96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:54.122784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5387e6ed-4860-4fbb-be31-138c8bfc5250 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:54.124236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5387e6ed-4860-4fbb-be31-138c8bfc5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:54.194132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 469/927] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:54.204426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 459/928] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:54.217149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00eab3-ca00-4467-b4ac-fd3fe4fe96b3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.229066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387e6ed-4860-4fbb-be31-138c8bfc5250 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.340280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00eab3-ca00-4467-b4ac-fd3fe4fe96b3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.345233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387e6ed-4860-4fbb-be31-138c8bfc5250 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.379458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.380688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.381198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.381699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.389089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.390214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.390508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.390787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.391441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:54.392964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:54.393824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:54.403256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:54.404202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:53:54.405040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:54.406229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:54.407178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:54.408004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:54.417021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 460/930] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:54.417021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.417520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 470/930] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:54.418934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.536968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c83cb0-9e4b-4033-af74-be1384828aeb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.544099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d50d23-a03c-46d4-966f-8ad3662bae79 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.582373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.583037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.583317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.583590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.584288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:54.584591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:54.585968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:54.586268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.586956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.587221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.587748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.588341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:54.588651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:54.591263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:54.591424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 461/931] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:54.598419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.605285 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 471/932] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:54.606566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.695781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c98e-3887-4731-83b2-00a430ee9f5a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.704401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445bc06-8286-41d7-86ff-ff1a42f42aa5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.738164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.739395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.739676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.739950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.740648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:54.740955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:54.742340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:54.744081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.744877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.745154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.745427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.752135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 462/933] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:54.758626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.759600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:54.762087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:54.780516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:54.781420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:54.782375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:54.782375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:54.782375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:54.782375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:54.784626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 472/934] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:54.793582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.874115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b7b5-8b36-4543-8b28-156d7d174b9f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.908148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.909035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.909485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.910006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.910962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] RBAC: Adding query filter params (interface=public, service_id=3cda02dec2724300abf584b237a23840, region_id=RegionOne) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:54.911452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:54.912983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:54.917958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197141a-2778-4cb2-a316-65c13ba9c5d9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:54.922912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 463/935] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/endpoints?service_id=3cda02dec2724300abf584b237a23840&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:54.923977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:54.960911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:54.961662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:54.961944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:54.962261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:54.962988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:54.963293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:54.964718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:54.981549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 473/936] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:54.987241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:55.034207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48768-e1e0-444d-8118-782554efb3b2 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:55.068569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:55.069211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.069529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.069810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.070779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:55.071834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:55.083638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 464/937] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:53:55.098647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a146297-0be1-4ec9-af11-cbba4215e07a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:55.137635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:55.138874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.139390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.139862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.149045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:55.150940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:55.167443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:55.168500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:55.169449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:55.176811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 474/938] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:53:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:55.178519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:55.290335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317c58-923f-49b1-bc83-c80cc46e25c5 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:55.324863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:55.325457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.325777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.326065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.326926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:55.327248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:55.328724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:55.346834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 465/939] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 18:53:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:55.352769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:55.458344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdde86-84f7-4972-9b1a-a1544b9eb8d7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:55.492430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:55.493212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.493495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.493770 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.503842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:55.505277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:55.522849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:55.523833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:55.525002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:55.525002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:55.525002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:55.525002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:55.525002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 475/940] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:55.531754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:55.636492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130ac1-20a2-4411-a2a1-1606c2947b20 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:55.671031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74294561-4d20-4562-ba54-d31494952d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:55.672033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74294561-4d20-4562-ba54-d31494952d61 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.672517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74294561-4d20-4562-ba54-d31494952d61 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.673007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74294561-4d20-4562-ba54-d31494952d61 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.673969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74294561-4d20-4562-ba54-d31494952d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:55.674475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74294561-4d20-4562-ba54-d31494952d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:55.676593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74294561-4d20-4562-ba54-d31494952d61 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:55.692717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 466/941] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:55.694513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:55.726421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59526-cf35-42b0-909f-578023ef2030 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.727034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59526-cf35-42b0-909f-578023ef2030 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.727535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59526-cf35-42b0-909f-578023ef2030 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.729359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 467/942] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:55.735777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de94cd-0cc1-44b1-aaf8-cf7192552c8f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.736066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de94cd-0cc1-44b1-aaf8-cf7192552c8f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.736329 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de94cd-0cc1-44b1-aaf8-cf7192552c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.753165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-37de94cd-0cc1-44b1-aaf8-cf7192552c8f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:55.754398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-37de94cd-0cc1-44b1-aaf8-cf7192552c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:55.829893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 468/943] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:53:55.839379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eec31-cc55-46cd-a1a2-b63ec1f41196 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:55.855111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de94cd-0cc1-44b1-aaf8-cf7192552c8f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:55.875246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:55.876033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:55.876306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:55.876571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:55.883446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:55.884896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:55.899671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:55.900580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:55.901942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 476/944] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:55.906587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:55.968129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de94cd-0cc1-44b1-aaf8-cf7192552c8f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.007796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.008455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.008730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.008997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.009706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.011135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.012463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING keystone.server.flask.common [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 18:53:56.015501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece327-6ca0-4c25-b707-df2623db7e1b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.029860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.sql.core [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 18:53:56.029860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 18:53:56.029860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [parameters: {'id': 'b51ef02f177048d38762661e1b230489', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 18:53:56.029860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79881) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-9de1873f-b793-413c-88f5-f44f0bee8340 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b51ef02f177048d38762661e1b230489.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b51ef02f177048d38762661e1b230489. May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application conn.query(q) May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:53:56.047159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application result.read() May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 18:53:56.048203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application next(self.gen) May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application yield resource May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application next(self.gen) May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self.session.rollback() May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self.force_reraise() May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise self.value May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application session.commit() May 04 18:53:56.049226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._prepare_impl() May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self.session.flush() May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._flush(objects) May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application compat.raise_( May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application flush_context.execute() May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 18:53:56.050720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rec.execute(self) May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 18:53:56.051648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application conn.query(q) May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application result.read() May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:53:56.052424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [parameters: {'id': 'b51ef02f177048d38762661e1b230489', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:56.054754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:56.056687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b51ef02f177048d38762661e1b230489. May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 469/945] 10.222.0.69 () {60 vars in 1140 bytes} [Wed May 4 18:53:55 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206d2f-985f-4217-b8bb-ff43458f6ba3 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.059074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206d2f-985f-4217-b8bb-ff43458f6ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.061039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206d2f-985f-4217-b8bb-ff43458f6ba3 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.061197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4e831-6bf1-4853-8f2c-338dee548b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.061197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e831-6bf1-4853-8f2c-338dee548b7a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.061197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e831-6bf1-4853-8f2c-338dee548b7a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.061197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4e831-6bf1-4853-8f2c-338dee548b7a None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.062269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4e831-6bf1-4853-8f2c-338dee548b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:56.062269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4e831-6bf1-4853-8f2c-338dee548b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.062551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 470/946] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:56.062692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4e831-6bf1-4853-8f2c-338dee548b7a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.062843 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206d2f-985f-4217-b8bb-ff43458f6ba3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:56.072173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 477/947] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:56.078410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cd58-9862-44fc-806a-f8f3a083325d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.078693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cd58-9862-44fc-806a-f8f3a083325d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.078967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cd58-9862-44fc-806a-f8f3a083325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.099269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9894cd58-9862-44fc-806a-f8f3a083325d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:56.100448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9894cd58-9862-44fc-806a-f8f3a083325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:56.162989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206d2f-985f-4217-b8bb-ff43458f6ba3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.167810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 478/948] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:56.170336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894cd58-9862-44fc-806a-f8f3a083325d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:56.200322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.201112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.201411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.201668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.208883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.210516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:53:56.224110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:56.225017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:53:56.225950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.229805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 471/949] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:56.230887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:56.277480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894cd58-9862-44fc-806a-f8f3a083325d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.311165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.312059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.312334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.312606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/3c6b49d2b3904ceca7db22423b2e7a7e/roles/3b3778712e12487398645999425ac101` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.314852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=3c6b49d2b3904ceca7db22423b2e7a7e, role_id=3b3778712e12487398645999425ac101)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.316805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.329565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 479/950] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:53:56 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/3c6b49d2b3904ceca7db22423b2e7a7e/roles/3b3778712e12487398645999425ac101 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:56.330337 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:56.345391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea94f6c-36a5-4ee0-b666-f8ba8284f1fa None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.393156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.395416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.395997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.396810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.397982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.399672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:56.421556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:56.422671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:53:56.423519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:56.431797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 472/951] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:53:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:56.435156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:56.442996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f38c9-83fb-4b01-a494-cd1ad25afc9c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.481660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.482735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.483224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.483703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.484692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:56.485235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.486936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.506582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 480/952] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:56.568140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be7a5-ff27-40b7-aad0-14455000b6f8 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.609590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4debb-f732-4955-88ea-8cf0bf8741cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.610786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4debb-f732-4955-88ea-8cf0bf8741cb None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.611300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4debb-f732-4955-88ea-8cf0bf8741cb None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.611800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4debb-f732-4955-88ea-8cf0bf8741cb None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.613313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4debb-f732-4955-88ea-8cf0bf8741cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:56.613879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4debb-f732-4955-88ea-8cf0bf8741cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.615578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4debb-f732-4955-88ea-8cf0bf8741cb None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.625906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 473/953] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:53:56.628018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:56.735479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4e07b-ad83-4198-b225-8ec7892cbc76 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:56.770386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a37be-0164-47fc-a112-65a2bf7798d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:56.771013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a37be-0164-47fc-a112-65a2bf7798d8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:56.771298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a37be-0164-47fc-a112-65a2bf7798d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:56.771559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a37be-0164-47fc-a112-65a2bf7798d8 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:56.772263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a37be-0164-47fc-a112-65a2bf7798d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:56.772562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a37be-0164-47fc-a112-65a2bf7798d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:56.773944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a37be-0164-47fc-a112-65a2bf7798d8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:56.778834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 481/954] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:53:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:57.415224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13bab-25e3-4a5e-ab10-0700b2ce568d None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:57.415973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13bab-25e3-4a5e-ab10-0700b2ce568d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:57.415973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13bab-25e3-4a5e-ab10-0700b2ce568d None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:57.417379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 474/955] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:57.422777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361e4a-fbf6-434d-bb91-334a842edb23 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:57.423191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361e4a-fbf6-434d-bb91-334a842edb23 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:57.423368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361e4a-fbf6-434d-bb91-334a842edb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:57.440321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d9361e4a-fbf6-434d-bb91-334a842edb23 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:57.441579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d9361e4a-fbf6-434d-bb91-334a842edb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:57.509578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 482/956] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:53:57.533225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13bab-25e3-4a5e-ab10-0700b2ce568d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:57.638226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13bab-25e3-4a5e-ab10-0700b2ce568d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:57.672577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:57.673731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:57.674219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:57.674694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:57.675601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:57.677172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:57.689618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:57.690632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:53:57.692002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:57.694815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 475/957] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:53:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:57.701727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361e4a-fbf6-434d-bb91-334a842edb23 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:57.799637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361e4a-fbf6-434d-bb91-334a842edb23 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:57.840368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:57.841034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:57.841313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:57.841614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:57.842313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:57.842616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:57.843973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:57.849098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 483/958] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:53:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:57.854864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:57.957381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3bfd-0dd0-49f1-a104-cf7734eb77ac None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:57.998348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79331a6-b40c-4f9f-93b7-9e12e62d8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:57.999009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79331a6-b40c-4f9f-93b7-9e12e62d8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:57.999337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79331a6-b40c-4f9f-93b7-9e12e62d8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:57.999610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79331a6-b40c-4f9f-93b7-9e12e62d8fc3 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:58.000306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79331a6-b40c-4f9f-93b7-9e12e62d8fc3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:58.000608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79331a6-b40c-4f9f-93b7-9e12e62d8fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:58.002060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79331a6-b40c-4f9f-93b7-9e12e62d8fc3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:58.007589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 476/959] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:53:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:58.013242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:58.110179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60fdf2-b270-4af4-9722-b320545de792 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:58.144287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8002059-25ac-4d9a-9a51-d4851f543fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:58.145198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002059-25ac-4d9a-9a51-d4851f543fe3 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:58.145644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002059-25ac-4d9a-9a51-d4851f543fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:58.146140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002059-25ac-4d9a-9a51-d4851f543fe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:58.147360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002059-25ac-4d9a-9a51-d4851f543fe3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:58.148878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002059-25ac-4d9a-9a51-d4851f543fe3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:58.177666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 484/960] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:53:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:58.725544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeb405-ab0f-4471-820a-9f2f7be7ecd3 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:58.726272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeb405-ab0f-4471-820a-9f2f7be7ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:58.726272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeb405-ab0f-4471-820a-9f2f7be7ecd3 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:58.727699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 477/961] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:58.733041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa593e-1c52-4f28-9ecf-f9fe2ce49cfe None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:58.733582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa593e-1c52-4f28-9ecf-f9fe2ce49cfe None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:58.733765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa593e-1c52-4f28-9ecf-f9fe2ce49cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:58.750886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fcfa593e-1c52-4f28-9ecf-f9fe2ce49cfe None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:58.752058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fcfa593e-1c52-4f28-9ecf-f9fe2ce49cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:58.829613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 485/962] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:58.853992 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeb405-ab0f-4471-820a-9f2f7be7ecd3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:58.877534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d8d03-7153-4d94-a362-3cbb61195e7b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:58.877847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d8d03-7153-4d94-a362-3cbb61195e7b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:58.878080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d8d03-7153-4d94-a362-3cbb61195e7b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:58.879738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 486/963] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:53:58.884494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323705c-5f48-4aca-8849-aed1bb9ce05f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:58.884774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323705c-5f48-4aca-8849-aed1bb9ce05f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:58.885042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323705c-5f48-4aca-8849-aed1bb9ce05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:58.902200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f323705c-5f48-4aca-8849-aed1bb9ce05f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:58.903366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f323705c-5f48-4aca-8849-aed1bb9ce05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:58.978714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeb405-ab0f-4471-820a-9f2f7be7ecd3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:58.981559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 487/964] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:59.004751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323705c-5f48-4aca-8849-aed1bb9ce05f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.022129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.023367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.024059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.024482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.038493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:53:59.048853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:59.049957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:53:59.050875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:59.051509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 478/965] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 18:53:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:59.057394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.116808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323705c-5f48-4aca-8849-aed1bb9ce05f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.152511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec30013-62de-4565-950c-77955d286783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.153229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec30013-62de-4565-950c-77955d286783 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.153441 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec30013-62de-4565-950c-77955d286783 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.153815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec30013-62de-4565-950c-77955d286783 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.154413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec30013-62de-4565-950c-77955d286783 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.155823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec30013-62de-4565-950c-77955d286783 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.157158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING keystone.server.flask.common [None req-3ec30013-62de-4565-950c-77955d286783 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 18:53:59.170104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.sql.core [None req-3ec30013-62de-4565-950c-77955d286783 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 18:53:59.170104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 18:53:59.170104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [parameters: {'user_id': 'ee30440261f845acabb5c5050467f09f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 18:53:59.170104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79880) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3ec30013-62de-4565-950c-77955d286783 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application conn.query(q) May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result.read() May 04 18:53:59.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:53:59.178551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application next(self.gen) May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application yield resource May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application next(self.gen) May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.session.rollback() May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.force_reraise() May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise self.value May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application session.commit() May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 18:53:59.179509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._prepare_impl() May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.session.flush() May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._flush(objects) May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application compat.raise_( May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application flush_context.execute() May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rec.execute(self) May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 18:53:59.180432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:53:59.181314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application conn.query(q) May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result.read() May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:53:59.184264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ee30440261f845acabb5c5050467f09f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:59.187042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 18:53:59.189939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 488/966] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 18:53:59 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba07604-92f0-4cbf-9482-9f0d6ed7fcf6 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba07604-92f0-4cbf-9482-9f0d6ed7fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.193314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba07604-92f0-4cbf-9482-9f0d6ed7fcf6 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.195726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 489/967] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:53:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:59.195726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba07604-92f0-4cbf-9482-9f0d6ed7fcf6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.196678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bbc46-0979-43f1-801e-75c534fedf26 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.226198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106ed82-db40-4ae1-b2d9-438c86aefd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.226791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ed82-db40-4ae1-b2d9-438c86aefd35 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.227069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ed82-db40-4ae1-b2d9-438c86aefd35 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.227337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ed82-db40-4ae1-b2d9-438c86aefd35 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.228077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106ed82-db40-4ae1-b2d9-438c86aefd35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:59.228380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106ed82-db40-4ae1-b2d9-438c86aefd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.229760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106ed82-db40-4ae1-b2d9-438c86aefd35 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.242279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 479/968] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 18:53:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:59.242279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69424b6-0d24-4724-83f5-bf176ba377aa None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.242279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69424b6-0d24-4724-83f5-bf176ba377aa None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.242279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69424b6-0d24-4724-83f5-bf176ba377aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.256737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d69424b6-0d24-4724-83f5-bf176ba377aa None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:59.258292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d69424b6-0d24-4724-83f5-bf176ba377aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:59.302683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba07604-92f0-4cbf-9482-9f0d6ed7fcf6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.325601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 480/969] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:53:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:53:59.325601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69424b6-0d24-4724-83f5-bf176ba377aa None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.347963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.349205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.350007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.350459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.361699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.363785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:59.382176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:59.383336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:53:59.384647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:59.386611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 490/970] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:53:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:59.387559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.434053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69424b6-0d24-4724-83f5-bf176ba377aa None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.467373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.468154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.468430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.468731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.478562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.479931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.487483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673285c9-fa20-4eeb-b75b-891bd3cf344b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:53:59.497389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:59.498570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:59.499487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:53:59.499487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:53:59.499487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:53:59.499487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:53:59.499487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 481/971] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:59.499487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.526225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.526879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.527152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.527424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.528131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.529490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.543955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 491/972] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:53:59 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:59.544814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.640280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c577a-e674-494c-9a90-89c1ab6d9e17 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.658578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6522-fba1-4d9a-8968-7cb384e3f20e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.683562 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.684351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.684538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.684782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.685633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:59.685936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.687402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.705623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.706613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.706899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.707173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.707912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:59.708221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.709637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.723149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 492/973] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:59.728114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 482/974] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 18:53:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:59.740291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:59.854178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2314-2a0b-4871-ad24-0e3963aea759 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:59.893603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:59.893603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:59.893603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:59.893603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:59.902280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:59.904035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:53:59.920604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:53:59.921746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:53:59.922822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:53:59.925165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 493/975] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:53:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:53:59.932219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.036043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865cc09-a706-4bd7-9d0d-2ff190f132e3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:00.069748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:00.070422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.070704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.070978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.071806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:00.072113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:00.073546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:00.089907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 483/976] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 18:53:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:00.095579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.189959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d691fe-55d4-4a81-abb5-9b2430a5b692 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:00.221052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a89ead-a5e1-42e3-830c-dff74fa699f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:00.221718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89ead-a5e1-42e3-830c-dff74fa699f5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.222508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89ead-a5e1-42e3-830c-dff74fa699f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.222785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89ead-a5e1-42e3-830c-dff74fa699f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.287039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a89ead-a5e1-42e3-830c-dff74fa699f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:00.289440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a89ead-a5e1-42e3-830c-dff74fa699f5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:00.390161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 494/977] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:00.396660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.491986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5acc-7578-4405-bd90-3eae12d6dcd9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:00.502236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af751-b83b-4759-9b53-35d91f6c42c8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.502527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af751-b83b-4759-9b53-35d91f6c42c8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.502792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af751-b83b-4759-9b53-35d91f6c42c8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.504354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 495/978] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:54:00.508969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa79c3-6016-475c-990a-4dd82cf62e65 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.509258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa79c3-6016-475c-990a-4dd82cf62e65 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.509567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa79c3-6016-475c-990a-4dd82cf62e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.526288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:00.526492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d0aa79c3-6016-475c-990a-4dd82cf62e65 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:00.527471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.527848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d0aa79c3-6016-475c-990a-4dd82cf62e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:00.528125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.528583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.540042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:00.541782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:00.559595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:00.560634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:00.561739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:00.561739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:00.561739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:00.561739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:00.563696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 484/979] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:00.570773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.598949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 496/980] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:54:00.621425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa79c3-6016-475c-990a-4dd82cf62e65 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.665724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6924f-906f-4d10-aaa8-e30fbf4b0f43 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:00.700644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:00.701303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.701638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.701880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.702593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:00.702895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:00.704253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:00.716166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 485/981] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:00.716439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa79c3-6016-475c-990a-4dd82cf62e65 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:00.721204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.749627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:00.750455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.750735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.751005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.751670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:00.753097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:00.766324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:00.773263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:00.774346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 497/982] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:00.775324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.825559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403800f-ff04-4284-bded-99266bb75a4b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:00.858488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:00.859281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.859565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.859838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.866294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:00.867719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:00.869533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0da6e-3438-4117-8939-92051a9240ba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:54:00.882039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:00.883145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:00.884072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 486/983] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:00.888766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.905104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:00.905979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:00.906430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:00.906854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:00.907717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:00.908185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:00.909731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:00.914519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 498/984] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:00.919958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:00.984611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aae7d-1721-458f-bc3f-8e6c8dfc5fcc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:01.017791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:01.018454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:01.018736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:01.019558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:01.020602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:01.020907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:01.021016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb8ae-484f-47d7-9066-8d7dea4b7c58 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:01.022359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:01.038538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 487/985] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:01.039543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:01.060143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:01.060805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:01.061084 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:01.061360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:01.062440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:01.062440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:01.063735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:01.068940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 499/986] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:54:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:01.074595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:01.141686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27debe5-0d72-4d61-87ce-c98557cd5e68 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:01.170900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8422-4e98-4ae5-8439-2a7439eaebea None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:01.174211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:01.174862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:01.175626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:01.175900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:01.176713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] RBAC: Adding query filter params (role.id=3b3778712e12487398645999425ac101, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=3c6b49d2b3904ceca7db22423b2e7a7e) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:01.177022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:01.178472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:01.193497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 488/987] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:01 2022] GET /identity/v3/role_assignments?user.id=3c6b49d2b3904ceca7db22423b2e7a7e&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=3b3778712e12487398645999425ac101 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:01.205659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e83180-d445-495d-9fc7-74f2d5a3634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:01.206330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83180-d445-495d-9fc7-74f2d5a3634a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:01.206610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83180-d445-495d-9fc7-74f2d5a3634a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:01.206884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83180-d445-495d-9fc7-74f2d5a3634a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:01.207695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83180-d445-495d-9fc7-74f2d5a3634a None admin] RBAC: Adding query filter params (interface=admin, service_id=3cda02dec2724300abf584b237a23840, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:01.208006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83180-d445-495d-9fc7-74f2d5a3634a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:01.209392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83180-d445-495d-9fc7-74f2d5a3634a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:01.215207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 500/988] 10.222.0.69 () {56 vars in 1249 bytes} [Wed May 4 18:54:01 2022] GET /identity/v3/endpoints?service_id=3cda02dec2724300abf584b237a23840&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:01.220970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:01.323903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fab4b-6402-42e5-9da8-3cb2e84c94bc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:01.360018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93756baf-e3d1-4b1f-89c5-53688a99e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:01.360692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93756baf-e3d1-4b1f-89c5-53688a99e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:01.360971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93756baf-e3d1-4b1f-89c5-53688a99e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:01.361239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93756baf-e3d1-4b1f-89c5-53688a99e4b5 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:01.361947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93756baf-e3d1-4b1f-89c5-53688a99e4b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:01.363852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93756baf-e3d1-4b1f-89c5-53688a99e4b5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:01.370550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 489/989] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:54:01 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:54:01.898695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378d70-cdb9-4795-ab9b-272e634b885f None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:01.899215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378d70-cdb9-4795-ab9b-272e634b885f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:01.899294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378d70-cdb9-4795-ab9b-272e634b885f None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:01.900651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 501/990] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:01.905762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4ea6a-fd62-4159-93ba-99a985ec6d24 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:01.906164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4ea6a-fd62-4159-93ba-99a985ec6d24 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:01.906324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4ea6a-fd62-4159-93ba-99a985ec6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:01.923150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9ad4ea6a-fd62-4159-93ba-99a985ec6d24 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:01.924322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9ad4ea6a-fd62-4159-93ba-99a985ec6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:01.989090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 490/991] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:02.012238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d378d70-cdb9-4795-ab9b-272e634b885f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:02.112039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d378d70-cdb9-4795-ab9b-272e634b885f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:02.144477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:02.145572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:02.145851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:02.146120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:02.146767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:02.148116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:02.160378 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:02.161362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:02.162640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 502/992] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:54:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:02.169604 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4ea6a-fd62-4159-93ba-99a985ec6d24 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:02.263323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4ea6a-fd62-4159-93ba-99a985ec6d24 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:02.296060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:02.296731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:02.297012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:02.297288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:02.298024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:02.298330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:02.299701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:02.310532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 491/993] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:54:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:02.312242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:02.410656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df97d-b3e4-42a0-8e9f-c6901f46e542 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:02.445767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:02.446426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:02.446705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:02.446979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:02.447673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] RBAC: Adding query filter params (type=compute) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:02.447978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:02.449326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:02.459203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 503/994] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:54:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:02.460656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:02.556218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b5124-44aa-4f15-ab84-0292ab717a54 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:02.587673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4fec-7570-4e07-9fde-47e05945c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:02.588323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4fec-7570-4e07-9fde-47e05945c059 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:02.588607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4fec-7570-4e07-9fde-47e05945c059 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:02.588882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4fec-7570-4e07-9fde-47e05945c059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:02.589689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4fec-7570-4e07-9fde-47e05945c059 None admin] RBAC: Adding query filter params (interface=public, service_id=169c374ae11e43f48d2fcb43090d6370, region_id=RegionOne) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:02.590002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4fec-7570-4e07-9fde-47e05945c059 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:02.591357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4fec-7570-4e07-9fde-47e05945c059 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:02.604175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 492/995] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:54:02 2022] GET /identity/v3/endpoints?service_id=169c374ae11e43f48d2fcb43090d6370&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:02.606401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:02.700901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8102a-47f1-4059-86d7-a71ccaae4dcb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:02.732105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b478-3680-49c6-8efa-8e2657130faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:02.732761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b478-3680-49c6-8efa-8e2657130faf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:02.733034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b478-3680-49c6-8efa-8e2657130faf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:02.733301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b478-3680-49c6-8efa-8e2657130faf None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:02.734002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b478-3680-49c6-8efa-8e2657130faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:02.735346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b478-3680-49c6-8efa-8e2657130faf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:02.749549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 504/996] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:54:02 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:54:03.496673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08445-3185-4fe9-a20e-205e2a5432c8 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:03.497227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08445-3185-4fe9-a20e-205e2a5432c8 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:03.497227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08445-3185-4fe9-a20e-205e2a5432c8 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:03.498800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 493/997] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:03.503758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfc90f-6320-43f9-87b5-401e4dd9703d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:03.504143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfc90f-6320-43f9-87b5-401e4dd9703d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:03.504306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfc90f-6320-43f9-87b5-401e4dd9703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:03.521304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-24dfc90f-6320-43f9-87b5-401e4dd9703d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:03.522512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-24dfc90f-6320-43f9-87b5-401e4dd9703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:03.586264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 505/998] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:03.595039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd9adc-95fd-49c3-b971-88722a62305a None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:03.595326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd9adc-95fd-49c3-b971-88722a62305a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:03.595603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd9adc-95fd-49c3-b971-88722a62305a None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:03.597708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 494/999] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:03.602466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13ce72-6625-46b3-99cf-d096203cf1c2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:03.602755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13ce72-6625-46b3-99cf-d096203cf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:03.603030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13ce72-6625-46b3-99cf-d096203cf1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:03.608194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd9adc-95fd-49c3-b971-88722a62305a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:03.619207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bf13ce72-6625-46b3-99cf-d096203cf1c2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:03.620366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bf13ce72-6625-46b3-99cf-d096203cf1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:03.689800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 506/1000] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:03.706177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd9adc-95fd-49c3-b971-88722a62305a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:03.712850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13ce72-6625-46b3-99cf-d096203cf1c2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:03.739413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:03.740205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:03.740487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:03.740762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] PATH_INFO: `/v3/services/image` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:03.741405 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:03.742803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:03.754957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:03.755926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:03.756756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:03.761180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 495/1001] 10.222.0.69 () {56 vars in 1105 bytes} [Wed May 4 18:54:03 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:03.761826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:03.812170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13ce72-6625-46b3-99cf-d096203cf1c2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:03.845868 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:03.847104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:03.847383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:03.847920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:03.848563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:03.850671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:03.857674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83095821-5130-4365-a2a7-216bd7cd3623 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:03.865665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:03.866732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:03.867802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 507/1002] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 18:54:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:03.873051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:03.895672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:03.896332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:03.896711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:03.896985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:03.897709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] RBAC: Adding query filter params (name=image) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:03.898012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:03.899358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:03.908555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 496/1003] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:03.909606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:03.972730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0bbe1-2f3d-4ec6-a58b-bdd8091dbc1f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:04.004401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:04.005113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:04.005335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:04.005635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:04.005811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061ace-ef75-4bc6-a929-64712740753e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:04.006334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:04.006634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:04.008435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:04.012631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 508/1004] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:54:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:04.018242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:04.038923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:04.039579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:04.039875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:04.040114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:04.040799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] RBAC: Adding query filter params (type=image) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:04.041096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:04.042472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:04.053720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 497/1005] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:04.118623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc20f1-bc8b-47bd-bff3-c2be2148831c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:04.153628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7149a-cf09-4d00-8917-8fdb3e6b612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:04.154305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7149a-cf09-4d00-8917-8fdb3e6b612a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:04.154580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7149a-cf09-4d00-8917-8fdb3e6b612a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:04.154849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7149a-cf09-4d00-8917-8fdb3e6b612a None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:04.155560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7149a-cf09-4d00-8917-8fdb3e6b612a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:04.155863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7149a-cf09-4d00-8917-8fdb3e6b612a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:04.157240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7149a-cf09-4d00-8917-8fdb3e6b612a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:04.167145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 509/1006] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 18:54:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:04.168826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:04.270901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6568e-e073-49b8-9b1c-5c85fb21a719 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:04.303010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5ec0c-cff7-44ba-b5ae-b77e56466d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:04.303676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5ec0c-cff7-44ba-b5ae-b77e56466d39 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:04.304144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5ec0c-cff7-44ba-b5ae-b77e56466d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:04.304527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5ec0c-cff7-44ba-b5ae-b77e56466d39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:04.305341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5ec0c-cff7-44ba-b5ae-b77e56466d39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:04.307536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5ec0c-cff7-44ba-b5ae-b77e56466d39 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:04.323965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 498/1007] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:54:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:05.005089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf45c-3c14-43da-b828-808e071a057a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:05.005604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf45c-3c14-43da-b828-808e071a057a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:05.005682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf45c-3c14-43da-b828-808e071a057a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:05.007186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 510/1008] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:05.012136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b997b-c48d-40d9-aa37-5dfaadb1342c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:05.012540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b997b-c48d-40d9-aa37-5dfaadb1342c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:05.012704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b997b-c48d-40d9-aa37-5dfaadb1342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:05.030765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-258b997b-c48d-40d9-aa37-5dfaadb1342c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:05.031950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-258b997b-c48d-40d9-aa37-5dfaadb1342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:05.101864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 499/1009] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:05.124441 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facf45c-3c14-43da-b828-808e071a057a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:05.225416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facf45c-3c14-43da-b828-808e071a057a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:05.256891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:05.257730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:05.258012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:05.258285 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] PATH_INFO: `/v3/services/compute` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:05.258928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:05.260273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:05.272523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:05.273529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:05.282396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 511/1010] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:54:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:05.283228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b997b-c48d-40d9-aa37-5dfaadb1342c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:05.373735 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b997b-c48d-40d9-aa37-5dfaadb1342c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:05.407027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:05.407698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:05.407981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:05.408257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:05.408957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] RBAC: Adding query filter params (name=compute) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:05.409294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:05.410695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:05.419995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 500/1011] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:54:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:05.420972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:05.520193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11838aa-6fb1-4ec1-9f8e-c5b818b1ccbc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:05.549818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2eee49-30a1-47c6-83f3-1e6a01863284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:05.550990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eee49-30a1-47c6-83f3-1e6a01863284 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:05.551268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eee49-30a1-47c6-83f3-1e6a01863284 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:05.551539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eee49-30a1-47c6-83f3-1e6a01863284 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:05.552245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eee49-30a1-47c6-83f3-1e6a01863284 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:05.552549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eee49-30a1-47c6-83f3-1e6a01863284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:05.553959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eee49-30a1-47c6-83f3-1e6a01863284 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:05.558891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 512/1012] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 18:54:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:05.564218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:05.656920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad3e9-7ea9-4c0e-878e-e66a3d5f68be None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:05.688577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2231c5d-38c5-49e4-b578-279ea5389689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:05.689232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2231c5d-38c5-49e4-b578-279ea5389689 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:05.689534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2231c5d-38c5-49e4-b578-279ea5389689 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:05.689811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2231c5d-38c5-49e4-b578-279ea5389689 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:05.690612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2231c5d-38c5-49e4-b578-279ea5389689 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:05.692462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2231c5d-38c5-49e4-b578-279ea5389689 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:05.714349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 501/1013] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:54:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:06.299672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c4b0-1f62-4f84-a163-95f5c13cde66 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:06.300175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c4b0-1f62-4f84-a163-95f5c13cde66 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:06.300254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c4b0-1f62-4f84-a163-95f5c13cde66 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:06.301847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 513/1014] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:06.306830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23645cc-12b5-47bf-8af0-c32e95367b2a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:06.307321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23645cc-12b5-47bf-8af0-c32e95367b2a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:06.307515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23645cc-12b5-47bf-8af0-c32e95367b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:06.324323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b23645cc-12b5-47bf-8af0-c32e95367b2a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:06.325540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b23645cc-12b5-47bf-8af0-c32e95367b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:06.396797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 502/1015] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:06 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:06.420172 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081c4b0-1f62-4f84-a163-95f5c13cde66 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:06.516536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081c4b0-1f62-4f84-a163-95f5c13cde66 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:06.549297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1c203-8f39-4a40-bb05-564405568065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:06.550073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c203-8f39-4a40-bb05-564405568065 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:06.550307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c203-8f39-4a40-bb05-564405568065 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:06.550584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c203-8f39-4a40-bb05-564405568065 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:06.551309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1c203-8f39-4a40-bb05-564405568065 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:06.552664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1c203-8f39-4a40-bb05-564405568065 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:06.567432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 514/1016] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:54:06 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:06.579327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf045a7-b06e-4092-83a7-ebad7bfd2d60 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:06.579637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf045a7-b06e-4092-83a7-ebad7bfd2d60 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:06.579889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf045a7-b06e-4092-83a7-ebad7bfd2d60 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:06.582097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 503/1017] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:06.587646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dc94-9c5c-46f6-a0a3-62f437cbc22a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:06.587944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dc94-9c5c-46f6-a0a3-62f437cbc22a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:06.588227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8dc94-9c5c-46f6-a0a3-62f437cbc22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:06.607327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-72d8dc94-9c5c-46f6-a0a3-62f437cbc22a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:06.608488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-72d8dc94-9c5c-46f6-a0a3-62f437cbc22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:06.686463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 515/1018] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:06.711635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf045a7-b06e-4092-83a7-ebad7bfd2d60 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:06.817777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf045a7-b06e-4092-83a7-ebad7bfd2d60 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:06.850715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eeff3-59b0-4c10-b4ef-3f51ffb437c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:06.851512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eeff3-59b0-4c10-b4ef-3f51ffb437c4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:06.851794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eeff3-59b0-4c10-b4ef-3f51ffb437c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:06.852066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eeff3-59b0-4c10-b4ef-3f51ffb437c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:06.853232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eeff3-59b0-4c10-b4ef-3f51ffb437c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:06.854688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eeff3-59b0-4c10-b4ef-3f51ffb437c4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:06.856461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 504/1019] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:06.862452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dc94-9c5c-46f6-a0a3-62f437cbc22a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:06.960356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8dc94-9c5c-46f6-a0a3-62f437cbc22a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:06.994022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3833-6719-4a2e-baad-39e4a88fe854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:06.994679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3833-6719-4a2e-baad-39e4a88fe854 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:06.994960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3833-6719-4a2e-baad-39e4a88fe854 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:06.995231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3833-6719-4a2e-baad-39e4a88fe854 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:06.995931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3833-6719-4a2e-baad-39e4a88fe854 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:06.997438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3833-6719-4a2e-baad-39e4a88fe854 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:07.029719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 516/1020] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:54:06 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:54:08.049343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d029-ca7b-4cc7-a2ed-840e65cc4fea None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.050366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d029-ca7b-4cc7-a2ed-840e65cc4fea None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.050444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d029-ca7b-4cc7-a2ed-840e65cc4fea None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.051968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 505/1021] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:08.056814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9c48f-399b-4ef7-8ebb-a695482e3a83 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.057232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9c48f-399b-4ef7-8ebb-a695482e3a83 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.057414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9c48f-399b-4ef7-8ebb-a695482e3a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.074511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-32a9c48f-399b-4ef7-8ebb-a695482e3a83 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:08.075790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-32a9c48f-399b-4ef7-8ebb-a695482e3a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:08.141509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 517/1022] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:08.163235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24d029-ca7b-4cc7-a2ed-840e65cc4fea None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:08.261892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24d029-ca7b-4cc7-a2ed-840e65cc4fea None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:08.294105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:08.294911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.295192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.295464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.305528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:08.314730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:08.316273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:08.323082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 506/1023] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 18:54:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:08.326719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9c48f-399b-4ef7-8ebb-a695482e3a83 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:08.419925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9c48f-399b-4ef7-8ebb-a695482e3a83 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:08.451896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:08.452555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.452840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.453107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.453860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:08.454158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:08.455533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:08.463425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 518/1024] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 18:54:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:08.468738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:08.564603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5052eb-0d96-4830-98bb-cfab9372a70b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:08.596050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:08.596860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.597133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.597402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.607241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:08.608658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:08.625382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:08.626400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:08.627292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:08.627292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:08.627292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:08.627292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:08.629813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 507/1025] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:08.632793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:08.729734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23562cf-78ab-46dc-b6a1-31f2cc6f6f0e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:08.762083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9759fd-7cf8-45ed-a675-45cb3590f5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:08.762740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9759fd-7cf8-45ed-a675-45cb3590f5bb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.763033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9759fd-7cf8-45ed-a675-45cb3590f5bb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.763303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9759fd-7cf8-45ed-a675-45cb3590f5bb None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.764005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9759fd-7cf8-45ed-a675-45cb3590f5bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:08.764306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9759fd-7cf8-45ed-a675-45cb3590f5bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:08.765672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9759fd-7cf8-45ed-a675-45cb3590f5bb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:08.781490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 519/1026] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:08.783234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:08.844886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ae1cd-6a10-46c0-b18e-081181864fb1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.845091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ae1cd-6a10-46c0-b18e-081181864fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.845409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ae1cd-6a10-46c0-b18e-081181864fb1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.846949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 520/1027] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:08.851654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbb858-5899-435d-ac22-5900f0995bac None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.851939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbb858-5899-435d-ac22-5900f0995bac None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.852214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbb858-5899-435d-ac22-5900f0995bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.869110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c7cbb858-5899-435d-ac22-5900f0995bac None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:08.870506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c7cbb858-5899-435d-ac22-5900f0995bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:08.884977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65f0d4-ccc8-47d5-8f11-8d6b819ee031 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:08.920531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:08.921326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:08.921633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:08.921901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] PATH_INFO: `/v3/users/nova` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:08.929893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:08.931309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:54:08.944965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:08.946130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:54:08.947274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:08.951065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 508/1028] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:54:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:08.953513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:08.953645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 521/1029] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:54:08.974966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbb858-5899-435d-ac22-5900f0995bac None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.054024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20981f55-87de-4dc5-844d-91e5fc457edc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.070423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbb858-5899-435d-ac22-5900f0995bac None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.086280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.086950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.087235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.087513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.088341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:09.088649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.090100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.103376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.104101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.104376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.104640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] PATH_INFO: `/v3/services/image` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.105266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.106656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.108745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 509/1030] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:54:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:09.115202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:09.119150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:09.120224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:09.121067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 522/1031] 10.222.0.69 () {56 vars in 1105 bytes} [Wed May 4 18:54:08 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:09.127808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.230747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906719-fc50-41c9-b6c1-baf44ddfe142 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.235724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba28cfa-3d9a-4430-9ac5-19d9c7656739 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.264788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a482b10-6201-4207-8c32-d6d12cec4c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.265719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482b10-6201-4207-8c32-d6d12cec4c61 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.265996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482b10-6201-4207-8c32-d6d12cec4c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.266277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482b10-6201-4207-8c32-d6d12cec4c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.269550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.270477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.270754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.271024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.271725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] RBAC: Adding query filter params (name=image) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:09.272030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.273393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.282813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 523/1032] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:09.283794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.333755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a482b10-6201-4207-8c32-d6d12cec4c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.335197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a482b10-6201-4207-8c32-d6d12cec4c61 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.379581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71ef7b-fb5b-4706-8caf-1ba05bdce3dc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.410490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3675b1-6755-40e1-b8a4-e96add36d03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.411153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3675b1-6755-40e1-b8a4-e96add36d03c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.411426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3675b1-6755-40e1-b8a4-e96add36d03c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.411694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3675b1-6755-40e1-b8a4-e96add36d03c None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.412383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3675b1-6755-40e1-b8a4-e96add36d03c None admin] RBAC: Adding query filter params (type=image) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:09.412679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3675b1-6755-40e1-b8a4-e96add36d03c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.414054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3675b1-6755-40e1-b8a4-e96add36d03c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.418710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 524/1033] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:09.419957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b486f9-78d5-44a6-a56c-0eea2cbd8880 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.420241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b486f9-78d5-44a6-a56c-0eea2cbd8880 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.420511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b486f9-78d5-44a6-a56c-0eea2cbd8880 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.421898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 525/1034] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:09.424457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b486f9-78d5-44a6-a56c-0eea2cbd8880 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.428969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 510/1035] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:09.430478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd20a3-39b1-4efd-8245-9e893f41bbdc None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.430766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd20a3-39b1-4efd-8245-9e893f41bbdc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.431095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd20a3-39b1-4efd-8245-9e893f41bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.448257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4ffd20a3-39b1-4efd-8245-9e893f41bbdc None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:09.449415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4ffd20a3-39b1-4efd-8245-9e893f41bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:09.510573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 511/1036] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:09.511377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd20a3-39b1-4efd-8245-9e893f41bbdc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.520126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b486f9-78d5-44a6-a56c-0eea2cbd8880 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.554671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.555331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.555604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.555876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.556663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] RBAC: Adding query filter params (interface=public, service_id=8d42131a3ccf46ccb4801ea0a187786b, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:09.560910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.562463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.568612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 526/1037] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/endpoints?service_id=8d42131a3ccf46ccb4801ea0a187786b&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:09.569406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.614124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd20a3-39b1-4efd-8245-9e893f41bbdc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.645767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.646486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.646763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.647030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.656428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.657986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.664971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27fbd-7f8c-477c-8e02-b90970d006b6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:09.675472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:09.676359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:09.677271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:09.677271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:09.677271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:09.677271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:09.677271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 512/1038] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:09.677594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.696727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.697526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.697812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.698079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.699237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.700636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.702289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 527/1039] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:09.703032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.772503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9613f7-959c-48ae-8648-d5d753dd6a52 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.797778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd5af8-d301-4ddc-aabb-8deecaea6e25 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.804999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.805703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.805968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.806244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.806912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.808262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.814536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 513/1040] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/services => generated 1957 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:54:09.815285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.830476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.831202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.831479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.831753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.832498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:09.832802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.834239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.852284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 528/1041] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:09.854284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:09.932073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43723-761f-4121-926c-a0a238bbb238 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.962487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77253d-42a4-463e-a33a-65949a83c7a6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:09.973433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:09.973433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:09.973433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:09.973433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:09.973931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:09.974043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:09.997056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 514/1042] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:54:09 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:10.002384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:10.003331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:10.003675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:10.004026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:10.011882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:10.013363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:54:10.029329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:10.030535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:10.031537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:10.032031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 529/1043] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:54:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:10.038176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:10.144574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b5fcc-14ca-4219-b502-ead50ef58065 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:10.182239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcff66-c38e-4075-ad8a-fbe1ce42fcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:10.183239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcff66-c38e-4075-ad8a-fbe1ce42fcc4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:10.183239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcff66-c38e-4075-ad8a-fbe1ce42fcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:10.183428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcff66-c38e-4075-ad8a-fbe1ce42fcc4 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:10.184909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcff66-c38e-4075-ad8a-fbe1ce42fcc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:10.184909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcff66-c38e-4075-ad8a-fbe1ce42fcc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:10.186222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcff66-c38e-4075-ad8a-fbe1ce42fcc4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:10.197701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 515/1044] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:54:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:10.204028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:10.304761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22bff9-5817-4e50-aa83-0fe147bf3979 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:10.340331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0de36-cd5c-4a96-b0e4-3764c85c545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:10.341139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0de36-cd5c-4a96-b0e4-3764c85c545f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:10.341418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0de36-cd5c-4a96-b0e4-3764c85c545f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:10.341723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0de36-cd5c-4a96-b0e4-3764c85c545f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:10.342550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0de36-cd5c-4a96-b0e4-3764c85c545f None admin] RBAC: Adding query filter params (role.id=3b3778712e12487398645999425ac101, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=ea420049f83643a19cb6c1d0a36fc8bc) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:10.342858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0de36-cd5c-4a96-b0e4-3764c85c545f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:10.344271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0de36-cd5c-4a96-b0e4-3764c85c545f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:10.350763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 530/1045] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:10 2022] GET /identity/v3/role_assignments?user.id=ea420049f83643a19cb6c1d0a36fc8bc&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=3b3778712e12487398645999425ac101 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:12.093846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afd9c-123e-40c7-8ea2-7e44d06e8c17 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.094386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afd9c-123e-40c7-8ea2-7e44d06e8c17 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.094386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afd9c-123e-40c7-8ea2-7e44d06e8c17 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.095905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 516/1046] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:12.101098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a23e-4151-46c7-9a07-dd59c0dce494 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.101513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a23e-4151-46c7-9a07-dd59c0dce494 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.101689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a23e-4151-46c7-9a07-dd59c0dce494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.117995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0984a23e-4151-46c7-9a07-dd59c0dce494 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:12.119171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0984a23e-4151-46c7-9a07-dd59c0dce494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:12.188368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 531/1047] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:12.211806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04afd9c-123e-40c7-8ea2-7e44d06e8c17 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.309923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04afd9c-123e-40c7-8ea2-7e44d06e8c17 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:12.328101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05d87-5095-4c7f-8128-bc6607f43aad None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.328401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05d87-5095-4c7f-8128-bc6607f43aad None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.328658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05d87-5095-4c7f-8128-bc6607f43aad None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.330070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 532/1048] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:12.336755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ea63-ed5a-45af-b39e-1d3a5eead52d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.337040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ea63-ed5a-45af-b39e-1d3a5eead52d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.337315 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ea63-ed5a-45af-b39e-1d3a5eead52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.343494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:12.344283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.344564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.344838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] PATH_INFO: `/v3/services/image` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.345505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:12.346900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:12.354479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e623ea63-ed5a-45af-b39e-1d3a5eead52d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:12.355692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e623ea63-ed5a-45af-b39e-1d3a5eead52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:12.358303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:12.359491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:12.360818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 517/1049] 10.222.0.69 () {56 vars in 1105 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:12.365851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.428682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 533/1050] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:54:12.452606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623ea63-ed5a-45af-b39e-1d3a5eead52d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.466058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a71ce-c01d-42c9-94fb-ce48460579dd None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:12.499886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:12.500551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.500834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.501113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.501839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] RBAC: Adding query filter params (name=image) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:12.502147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:12.504058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:12.508714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 518/1051] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:12.514272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.551048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623ea63-ed5a-45af-b39e-1d3a5eead52d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:12.584460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d5d52-56cc-4627-8654-def612c4b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:12.585170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5d52-56cc-4627-8654-def612c4b726 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.585446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5d52-56cc-4627-8654-def612c4b726 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.585743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5d52-56cc-4627-8654-def612c4b726 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.595287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d5d52-56cc-4627-8654-def612c4b726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b00d5d52-56cc-4627-8654-def612c4b726 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:12.602819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:12.603785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:12.604625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 534/1052] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:12.605345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b95cb-d283-4b25-adc8-5d7309f9fe69 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.605422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b95cb-d283-4b25-adc8-5d7309f9fe69 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.606017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b95cb-d283-4b25-adc8-5d7309f9fe69 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.607078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 535/1053] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:12.609500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ba9cf-1963-4e39-ac8e-0b66ea0d6d05 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:12.609708 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b95cb-d283-4b25-adc8-5d7309f9fe69 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.642118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f7568-45f3-4495-b50d-7873d4e26ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:12.642767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f7568-45f3-4495-b50d-7873d4e26ac0 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.643041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f7568-45f3-4495-b50d-7873d4e26ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.643309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f7568-45f3-4495-b50d-7873d4e26ac0 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.644019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f7568-45f3-4495-b50d-7873d4e26ac0 None admin] RBAC: Adding query filter params (type=image) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:12.644319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f7568-45f3-4495-b50d-7873d4e26ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:12.645965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f7568-45f3-4495-b50d-7873d4e26ac0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:12.650550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 519/1054] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:12.650550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a84d9f-9f7a-4392-8930-f5812471602e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.650550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a84d9f-9f7a-4392-8930-f5812471602e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.650550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a84d9f-9f7a-4392-8930-f5812471602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.669176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a1a84d9f-9f7a-4392-8930-f5812471602e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:12.670381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a1a84d9f-9f7a-4392-8930-f5812471602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:12.705360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b95cb-d283-4b25-adc8-5d7309f9fe69 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:12.731903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 520/1055] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:12.732703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a84d9f-9f7a-4392-8930-f5812471602e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.736962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:12.738197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.738476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.738743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.739469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:12.739768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:12.741115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:12.749523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 536/1056] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:12.754979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.828783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a84d9f-9f7a-4392-8930-f5812471602e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:12.851250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787262b-8213-4c2f-875d-910512fc08dd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:12.864906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278976-4804-4df9-a088-68347beeba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:12.865596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278976-4804-4df9-a088-68347beeba04 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.865877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278976-4804-4df9-a088-68347beeba04 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.866150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278976-4804-4df9-a088-68347beeba04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.866874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278976-4804-4df9-a088-68347beeba04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:12.868244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278976-4804-4df9-a088-68347beeba04 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:12.883815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:12.884678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:12.884955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:12.885231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] PATH_INFO: `/v3/users/8384d9e84e0f45cf84e765d9c9f6bd5e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:12.885627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 521/1057] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:54:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:12.886430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278976-4804-4df9-a088-68347beeba04 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.900461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] RBAC: Authorizing `identity:get_user(user_id=8384d9e84e0f45cf84e765d9c9f6bd5e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:12.901969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:12.908628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 537/1058] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/users/8384d9e84e0f45cf84e765d9c9f6bd5e => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:12.910400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:12.998683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278976-4804-4df9-a088-68347beeba04 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.026303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b723-7769-474b-88ba-ee2966acc25d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.033570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.034955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.035225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.035491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.046250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:13.054619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:13.055763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:13.056635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 522/1059] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:13.062007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.065220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d122db-ae68-4594-9308-3df77681524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.065961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d122db-ae68-4594-9308-3df77681524d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.066239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d122db-ae68-4594-9308-3df77681524d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.066511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d122db-ae68-4594-9308-3df77681524d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.134749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d122db-ae68-4594-9308-3df77681524d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.136104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d122db-ae68-4594-9308-3df77681524d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.162614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed5c8b-9734-4103-8013-e08634c41875 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.198729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.199892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.200385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.200704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.201479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:13.201797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.203171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.216472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 523/1060] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:13.217356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.245523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 538/1061] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:13.247195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d122db-ae68-4594-9308-3df77681524d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.317241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7292c3-94fd-42d8-a934-ab3aee7741d4 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.343977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d122db-ae68-4594-9308-3df77681524d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.350334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.351123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.351404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.351679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.361870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.363305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.378857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.379706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:13.379833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:13.380642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:13.381569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:13.381569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:13.381569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:13.381569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:13.381791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.381791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.381929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 524/1062] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:13.383156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] RBAC: Authorizing `identity:get_project(project_id=41ac10ea321b4087b263ccb79c327e2d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.384571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.386408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 539/1063] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:13.387124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.392182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.483236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ad73c-6103-4cec-b62a-69a742054de6 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.486789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a44cc-71ed-4d7e-b198-19dd70ea66d2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.523468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.524132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.524414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.524684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.525394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:13.527253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.527253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.537931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.538862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.539116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 525/1064] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:13.543416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.543730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.544441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.544612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=41ac10ea321b4087b263ccb79c327e2d, user.id=8384d9e84e0f45cf84e765d9c9f6bd5e) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:13.544881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.546348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.561781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 540/1065] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/role_assignments?user.id=8384d9e84e0f45cf84e765d9c9f6bd5e&scope.project.id=41ac10ea321b4087b263ccb79c327e2d&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:13.649684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4096a4-fbee-4574-8bf1-7c713491445e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.684583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.685831 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.686345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.686821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.695658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.697446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:54:13.713802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:13.714830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:54:13.715778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:13.718240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 526/1066] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:13.724244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.825786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c892ac0-1a1b-4201-b405-8d4a93caf02a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:13.859445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:13.860114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:13.860394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:13.860665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:13.861518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:13.861827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:13.863730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:13.885629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 541/1067] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:13.887192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:13.982413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e898-0962-44a6-ad1b-72ae0117d197 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:14.015698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:14.016489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:14.016767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:14.017039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:14.026945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:14.028373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:14.045619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:14.046627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:14.047630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:14.047630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:14.047630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:14.047630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:14.050357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 527/1068] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:14.053180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:14.151552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d94ed-6931-4a0e-ad2f-177b09d13508 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:14.186493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:14.187158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:14.187437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:14.187711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:14.188432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:14.188738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:14.190118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:14.205498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 542/1069] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:14.207257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:14.307113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9284d-423e-44a8-ae03-d8f6d8c7c621 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:14.341746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:14.342547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:14.342827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:14.343098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:14.350078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:14.351502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:54:14.365253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:14.366345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:14.368165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:14.369679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 528/1070] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:14.372269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:14.476335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2331-bf0a-4837-ade7-c0f6029a5712 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:14.509804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d0180-b7f4-434b-8392-78ba6f43f632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:14.510459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0180-b7f4-434b-8392-78ba6f43f632 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:14.510734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0180-b7f4-434b-8392-78ba6f43f632 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:14.510999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0180-b7f4-434b-8392-78ba6f43f632 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:14.511766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d0180-b7f4-434b-8392-78ba6f43f632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:14.512067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d0180-b7f4-434b-8392-78ba6f43f632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:14.513612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d0180-b7f4-434b-8392-78ba6f43f632 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:14.530714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 543/1071] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:54:14.532304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:14.627153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1a207-ca04-4c8a-8bbd-11f920f9af99 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:14.660513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514d4a5-672c-4dc1-9aff-ae175af6cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:14.661828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d4a5-672c-4dc1-9aff-ae175af6cff9 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:14.662306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d4a5-672c-4dc1-9aff-ae175af6cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:14.662755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d4a5-672c-4dc1-9aff-ae175af6cff9 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/ea420049f83643a19cb6c1d0a36fc8bc/roles/3b3778712e12487398645999425ac101` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:14.665231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514d4a5-672c-4dc1-9aff-ae175af6cff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=ea420049f83643a19cb6c1d0a36fc8bc, role_id=3b3778712e12487398645999425ac101)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:14.666923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514d4a5-672c-4dc1-9aff-ae175af6cff9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:14.680150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 529/1072] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:54:14 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/ea420049f83643a19cb6c1d0a36fc8bc/roles/3b3778712e12487398645999425ac101 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:54:15.179962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad547e3-814c-4b94-8db1-1fa3659c16b5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:15.180475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad547e3-814c-4b94-8db1-1fa3659c16b5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:15.180475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad547e3-814c-4b94-8db1-1fa3659c16b5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:15.182073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 544/1073] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:15.186930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a241f-ea6c-4aa1-8b29-25ba9c0f91c9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:15.187222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a241f-ea6c-4aa1-8b29-25ba9c0f91c9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:15.187507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a241f-ea6c-4aa1-8b29-25ba9c0f91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:15.204435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-464a241f-ea6c-4aa1-8b29-25ba9c0f91c9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:15.205621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-464a241f-ea6c-4aa1-8b29-25ba9c0f91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:15.272353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 530/1074] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:15.293890 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad547e3-814c-4b94-8db1-1fa3659c16b5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:15.394603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad547e3-814c-4b94-8db1-1fa3659c16b5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:15.426792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:15.427436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:15.427709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:15.427978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:15.492834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:15.494288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:15.591399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 545/1075] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:15.592846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a241f-ea6c-4aa1-8b29-25ba9c0f91c9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:15.689071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a241f-ea6c-4aa1-8b29-25ba9c0f91c9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:15.720678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f186b-028e-4ddf-8ce0-baa3b8cd5726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:15.722002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f186b-028e-4ddf-8ce0-baa3b8cd5726 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:15.722280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f186b-028e-4ddf-8ce0-baa3b8cd5726 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:15.722549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f186b-028e-4ddf-8ce0-baa3b8cd5726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:15.732112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f186b-028e-4ddf-8ce0-baa3b8cd5726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:15.733553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f186b-028e-4ddf-8ce0-baa3b8cd5726 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-391f186b-028e-4ddf-8ce0-baa3b8cd5726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:15.751202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:15.752144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:15.761063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:15.761063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:15.761063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:15.761063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:15.761063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 531/1076] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:15.761342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:15.783370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1528-555c-4f9b-954f-6d407b91e4d2 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:15.783658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1528-555c-4f9b-954f-6d407b91e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:15.784480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1528-555c-4f9b-954f-6d407b91e4d2 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:15.785917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 532/1077] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:54:15.791832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e28f-75b0-4d12-b2f6-52f51acbcb4d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:15.792117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e28f-75b0-4d12-b2f6-52f51acbcb4d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:15.792398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e28f-75b0-4d12-b2f6-52f51acbcb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:15.809590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-93d5e28f-75b0-4d12-b2f6-52f51acbcb4d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:15.810780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-93d5e28f-75b0-4d12-b2f6-52f51acbcb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:15.865261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5d8a-15a3-43a2-95c9-1285e8216f5f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:15.874896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 533/1078] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:54:15.897136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e28f-75b0-4d12-b2f6-52f51acbcb4d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:15.898144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:15.898802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:15.899078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:15.899343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:15.900055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:15.900351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:15.901721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:15.921563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 546/1079] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:16.001501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e28f-75b0-4d12-b2f6-52f51acbcb4d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:16.036711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:16.037544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:16.037827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:16.038100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:16.049264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:16.057090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:16.058355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:16.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 534/1080] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:16.064647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:16.166118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4966-7979-4a89-b8f4-ca4175449878 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:16.198572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:16.199236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:16.199519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:16.199796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:16.200538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:16.200846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:16.202226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:16.211185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 547/1081] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:16.217235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:16.313728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0a03-dafb-45e2-9ac3-26508f73a409 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:16.345205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e380-fb8f-461e-9651-610412095447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:16.346100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e380-fb8f-461e-9651-610412095447 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:16.346985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e380-fb8f-461e-9651-610412095447 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:16.347258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e380-fb8f-461e-9651-610412095447 None admin] PATH_INFO: `/v3/users/8384d9e84e0f45cf84e765d9c9f6bd5e` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:16.348421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e380-fb8f-461e-9651-610412095447 None admin] RBAC: Authorizing `identity:get_user(user_id=8384d9e84e0f45cf84e765d9c9f6bd5e)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:16.349883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e380-fb8f-461e-9651-610412095447 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:16.351492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 535/1082] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:16 2022] GET /identity/v3/users/8384d9e84e0f45cf84e765d9c9f6bd5e => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:16.357734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:16.453794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f4d84-7de8-4020-8eb8-773fd1bad714 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:16.484916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b1eb-bb8b-4306-825d-b72317cbc133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:16.485799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b1eb-bb8b-4306-825d-b72317cbc133 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:16.486076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b1eb-bb8b-4306-825d-b72317cbc133 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:16.486346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b1eb-bb8b-4306-825d-b72317cbc133 None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:16.487515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b1eb-bb8b-4306-825d-b72317cbc133 None admin] RBAC: Authorizing `identity:get_project(project_id=41ac10ea321b4087b263ccb79c327e2d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:16.488930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b1eb-bb8b-4306-825d-b72317cbc133 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:16.490683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 548/1083] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:16 2022] GET /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:16.496479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e380-fb8f-461e-9651-610412095447 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:16.591399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e380-fb8f-461e-9651-610412095447 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:16.622215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a318207-ecd8-4b57-97b9-462bd3d190c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:16.623097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318207-ecd8-4b57-97b9-462bd3d190c5 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:16.623376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318207-ecd8-4b57-97b9-462bd3d190c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:16.623646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318207-ecd8-4b57-97b9-462bd3d190c5 None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d/users/8384d9e84e0f45cf84e765d9c9f6bd5e/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:16.625582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a318207-ecd8-4b57-97b9-462bd3d190c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=41ac10ea321b4087b263ccb79c327e2d, user_id=8384d9e84e0f45cf84e765d9c9f6bd5e, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:16.627002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a318207-ecd8-4b57-97b9-462bd3d190c5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:16.640297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 536/1084] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:54:16 2022] PUT /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d/users/8384d9e84e0f45cf84e765d9c9f6bd5e/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:54:16.931590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64aa5-77cf-48ed-a885-ba4f4cd45a7e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:16.931879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64aa5-77cf-48ed-a885-ba4f4cd45a7e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:16.932156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64aa5-77cf-48ed-a885-ba4f4cd45a7e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:16.933570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 549/1085] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:16.938822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecb33c-e45f-4f9a-9ac4-e97f7c54b453 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:16.939115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecb33c-e45f-4f9a-9ac4-e97f7c54b453 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:16.939392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecb33c-e45f-4f9a-9ac4-e97f7c54b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:16.956099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d1ecb33c-e45f-4f9a-9ac4-e97f7c54b453 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:16.957296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d1ecb33c-e45f-4f9a-9ac4-e97f7c54b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:17.022307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 537/1086] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:17.045476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b64aa5-77cf-48ed-a885-ba4f4cd45a7e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:17.140763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b64aa5-77cf-48ed-a885-ba4f4cd45a7e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:17.172087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:17.172880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:17.173162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:17.173437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:17.183954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:17.191886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:17.192818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:17.193826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 550/1087] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 18:54:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:17.198930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecb33c-e45f-4f9a-9ac4-e97f7c54b453 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:17.290160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecb33c-e45f-4f9a-9ac4-e97f7c54b453 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:17.322393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:17.323053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:17.323327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:17.323592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:17.324317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:17.324616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:17.326001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:17.333568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 538/1088] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 18:54:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:17.339223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:17.432677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6736477-f432-47b9-99a7-56e53ce23cef None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:17.464066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:17.464783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:17.465061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:17.465332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:17.475347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:17.476762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:17.494822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:17.495706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:17.496606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:17.496606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:17.496606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:17.496606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:17.496606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 551/1089] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:17.501684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:17.594307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9782a-0fb2-4431-ad91-1900edcb400c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:17.625456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:17.626128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:17.626407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:17.626677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:17.627380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:17.627721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:17.629067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:17.640079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 539/1090] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:17.646367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:17.739780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e67f1-35ab-4a4d-b013-b40176bd397a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:17.772665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:17.773451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:17.773761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:17.774028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:17.780966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:17.782417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:54:17.796786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:17.797922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:17.798886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 552/1091] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 18:54:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:17.803700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:17.895340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2764ddb-b416-43c5-ad2c-c1d11c071ed9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:17.926228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:17.926871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:17.927147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:17.927414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:17.928220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:17.928519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:17.929947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:17.946303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 540/1092] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 18:54:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:17.951755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:18.045764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe14f-2ed7-4b15-bca7-918d650e2765 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:18.077532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:18.078163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.078438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.078709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.141155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:18.142632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:18.233197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 553/1093] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:54:18.239107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:18.332880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caee8b2-2340-420a-a801-1718fb8641db None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:18.364609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:18.365391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.365699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.365969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.375380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:18.376817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:18.393924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:18.395265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:18.396190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:54:18.396190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:18.396190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:54:18.396190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:18.396190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 541/1094] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:18.400943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:18.493455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dbc4e-8235-4653-aa28-cc1c941c7b7f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:18.526522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:18.527175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.527452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.527722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.528427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:18.528728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:18.530128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:18.540743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 554/1095] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:18.546331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:18.641664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb97403-8ec5-45e6-a746-3bfb68dc1f53 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:18.676595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d040b2-3cae-4aa1-8314-784fbd886ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:18.677414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d040b2-3cae-4aa1-8314-784fbd886ee8 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.677722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d040b2-3cae-4aa1-8314-784fbd886ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.677997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d040b2-3cae-4aa1-8314-784fbd886ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.685552 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d040b2-3cae-4aa1-8314-784fbd886ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:18.687024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d040b2-3cae-4aa1-8314-784fbd886ee8 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-17d040b2-3cae-4aa1-8314-784fbd886ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:54:18.701154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:18.702137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:18.703042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 542/1096] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:18.708204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:18.802676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4535-6c5b-49ad-ac6f-248506770bdc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:18.833533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:18.834175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.834451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.834719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.835485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:18.835787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:18.837190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:18.849327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 555/1097] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:18.849529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a19b-6de3-4b03-a6a6-5772f6193cd1 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.849673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a19b-6de3-4b03-a6a6-5772f6193cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.849956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a19b-6de3-4b03-a6a6-5772f6193cd1 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.851307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 543/1098] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:54:18.855016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:18.856107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097afaf-4b1c-48de-9551-e93862e44d91 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.856391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097afaf-4b1c-48de-9551-e93862e44d91 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.856700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097afaf-4b1c-48de-9551-e93862e44d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.873313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6097afaf-4b1c-48de-9551-e93862e44d91 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:18.874563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6097afaf-4b1c-48de-9551-e93862e44d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:18.936722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 544/1099] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:54:18.947234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f440-7485-4227-a28d-36aac0f25560 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:18.959850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097afaf-4b1c-48de-9551-e93862e44d91 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:18.979498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:18.980144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:18.980419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:18.980688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:18.981528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] RBAC: Adding query filter params (role.id=3b3778712e12487398645999425ac101, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=ea420049f83643a19cb6c1d0a36fc8bc) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:18.981837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:18.983245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:18.989437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 556/1100] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:18 2022] GET /identity/v3/role_assignments?user.id=ea420049f83643a19cb6c1d0a36fc8bc&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=3b3778712e12487398645999425ac101 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:19.058956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097afaf-4b1c-48de-9551-e93862e44d91 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:19.093455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:19.094280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:19.094563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:19.094838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:19.106071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:19.113885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:19.115053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:19.115971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 545/1101] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:54:19.121337 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:19.220962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa903d-ad61-4160-a3f3-a1128c79fbec None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:19.255759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:19.256420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:19.256697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:19.256967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:19.257768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:19.258074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:19.259426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:19.267344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 557/1102] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:19.273602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:19.372206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af10ee-6e2d-4c15-92a9-7c79a52caed3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:19.405332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004396f5-5a84-470c-9d13-840b986792db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:19.406235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004396f5-5a84-470c-9d13-840b986792db None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:19.406518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004396f5-5a84-470c-9d13-840b986792db None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:19.406785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004396f5-5a84-470c-9d13-840b986792db None admin] PATH_INFO: `/v3/users/8384d9e84e0f45cf84e765d9c9f6bd5e` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:19.407955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004396f5-5a84-470c-9d13-840b986792db None admin] RBAC: Authorizing `identity:get_user(user_id=8384d9e84e0f45cf84e765d9c9f6bd5e)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:19.409955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004396f5-5a84-470c-9d13-840b986792db None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:19.411575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 546/1103] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:19 2022] GET /identity/v3/users/8384d9e84e0f45cf84e765d9c9f6bd5e => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:19.417423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:19.514961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a9e3-e347-48e6-b518-d6e0591ca24a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:19.547740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:19.548385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:19.548662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:19.548934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:19.613609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:19.615057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:19.710954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 558/1104] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:19.717046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004396f5-5a84-470c-9d13-840b986792db None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:19.816411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004396f5-5a84-470c-9d13-840b986792db None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:19.849773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26684-ceef-43d7-9d99-dc42920cb664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:19.850628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26684-ceef-43d7-9d99-dc42920cb664 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:19.850906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26684-ceef-43d7-9d99-dc42920cb664 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:19.851176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26684-ceef-43d7-9d99-dc42920cb664 None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:19.852339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe26684-ceef-43d7-9d99-dc42920cb664 None admin] RBAC: Authorizing `identity:get_project(project_id=41ac10ea321b4087b263ccb79c327e2d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:19.853817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe26684-ceef-43d7-9d99-dc42920cb664 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:19.855500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 547/1105] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:19 2022] GET /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:19.862301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:19.953653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1d8d9-d242-4f5f-a7f9-76499ed71ea3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:19.986248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49813f9-b47c-4951-baf5-f91d39f6fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:19.987385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49813f9-b47c-4951-baf5-f91d39f6fa87 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:19.987665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49813f9-b47c-4951-baf5-f91d39f6fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:19.987936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49813f9-b47c-4951-baf5-f91d39f6fa87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:19.988802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49813f9-b47c-4951-baf5-f91d39f6fa87 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=41ac10ea321b4087b263ccb79c327e2d, user.id=8384d9e84e0f45cf84e765d9c9f6bd5e) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:19.989135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49813f9-b47c-4951-baf5-f91d39f6fa87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:19.990875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49813f9-b47c-4951-baf5-f91d39f6fa87 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:19.997028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 559/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:19 2022] GET /identity/v3/role_assignments?user.id=8384d9e84e0f45cf84e765d9c9f6bd5e&scope.project.id=41ac10ea321b4087b263ccb79c327e2d&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:22.241937 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd6170-69a5-4a5b-9162-bc2bc50ba285 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:22.242480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd6170-69a5-4a5b-9162-bc2bc50ba285 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:22.242480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd6170-69a5-4a5b-9162-bc2bc50ba285 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:22.243741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 548/1107] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:22.249091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dace-9ee7-4bcf-9fd9-4d6dac91b878 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:22.249551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dace-9ee7-4bcf-9fd9-4d6dac91b878 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:22.249646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dace-9ee7-4bcf-9fd9-4d6dac91b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:22.266572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4624dace-9ee7-4bcf-9fd9-4d6dac91b878 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:22.267736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4624dace-9ee7-4bcf-9fd9-4d6dac91b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:22.334833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 560/1108] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:22.361018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd6170-69a5-4a5b-9162-bc2bc50ba285 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:22.457611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd6170-69a5-4a5b-9162-bc2bc50ba285 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:22.488452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4819481-9fee-4e76-adb7-eae2e0221d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:22.489218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4819481-9fee-4e76-adb7-eae2e0221d89 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:22.489514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4819481-9fee-4e76-adb7-eae2e0221d89 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:22.489781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4819481-9fee-4e76-adb7-eae2e0221d89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:22.490911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4819481-9fee-4e76-adb7-eae2e0221d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:22.492363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4819481-9fee-4e76-adb7-eae2e0221d89 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:22.493900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 549/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:22.499535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624dace-9ee7-4bcf-9fd9-4d6dac91b878 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:22.590497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624dace-9ee7-4bcf-9fd9-4d6dac91b878 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:22.621636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62db774-1425-4441-860e-0c052c866868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:22.622301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62db774-1425-4441-860e-0c052c866868 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:22.622579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62db774-1425-4441-860e-0c052c866868 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:22.622850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62db774-1425-4441-860e-0c052c866868 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:22.623548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62db774-1425-4441-860e-0c052c866868 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:22.624967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62db774-1425-4441-860e-0c052c866868 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:22.645794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 561/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:54:22 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:54:24.884385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215761-9bf3-4fa3-862b-a5ccfe2d1865 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:24.884946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215761-9bf3-4fa3-862b-a5ccfe2d1865 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:24.884946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215761-9bf3-4fa3-862b-a5ccfe2d1865 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:24.886373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 550/1111] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:54:24.891554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463500-feb0-48bc-8178-afae65f4559a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:24.892028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463500-feb0-48bc-8178-afae65f4559a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:24.892243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463500-feb0-48bc-8178-afae65f4559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:24.911571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-80463500-feb0-48bc-8178-afae65f4559a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:24.912729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-80463500-feb0-48bc-8178-afae65f4559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:24.973795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 562/1112] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:24.997657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b215761-9bf3-4fa3-862b-a5ccfe2d1865 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:25.090708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b215761-9bf3-4fa3-862b-a5ccfe2d1865 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:25.121614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:25.122437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:25.122713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:25.122981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] PATH_INFO: `/v3/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:25.124403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] RBAC: Authorizing `identity:get_role(role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:25.125758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:25.127064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 551/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:24 2022] GET /identity/v3/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:25.132903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80463500-feb0-48bc-8178-afae65f4559a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:25.231534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80463500-feb0-48bc-8178-afae65f4559a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:25.261739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:25.262586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:25.262856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:25.263123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] PATH_INFO: `/v3/users/13d7d7170b954fbca5095ac365d0c0aa` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:25.275900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] RBAC: Authorizing `identity:get_user(user_id=13d7d7170b954fbca5095ac365d0c0aa)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:25.277311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:25.278942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 563/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:25 2022] GET /identity/v3/users/13d7d7170b954fbca5095ac365d0c0aa => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:25.285373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:25.378853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a1a9-feba-451b-8ad0-3ed01bb5a936 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:25.410665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:25.411290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:25.411564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:25.411831 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:25.473207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:25.474651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:25.563683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 552/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:25.570110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:25.663162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56177b8-0bf8-4a49-ada8-e74d83c0056c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:25.694844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478a83d-2f7b-45f3-936d-bedd95da458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:25.695682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a83d-2f7b-45f3-936d-bedd95da458b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:25.695958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a83d-2f7b-45f3-936d-bedd95da458b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:25.696227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a83d-2f7b-45f3-936d-bedd95da458b None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:25.697385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478a83d-2f7b-45f3-936d-bedd95da458b None admin] RBAC: Authorizing `identity:get_project(project_id=41ac10ea321b4087b263ccb79c327e2d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:25.698821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478a83d-2f7b-45f3-936d-bedd95da458b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:25.700485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 564/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:25 2022] GET /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:25.707165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:25.798682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a622d77-911c-4918-ab4a-a615d7a541f7 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:25.830585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e78ab-d7a2-43af-a88c-1c4d5dd11e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:25.831167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e78ab-d7a2-43af-a88c-1c4d5dd11e38 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:25.831443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e78ab-d7a2-43af-a88c-1c4d5dd11e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:25.831712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e78ab-d7a2-43af-a88c-1c4d5dd11e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:25.832520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e78ab-d7a2-43af-a88c-1c4d5dd11e38 None admin] RBAC: Adding query filter params (role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=41ac10ea321b4087b263ccb79c327e2d, user.id=13d7d7170b954fbca5095ac365d0c0aa) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:25.832829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e78ab-d7a2-43af-a88c-1c4d5dd11e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:25.834274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e78ab-d7a2-43af-a88c-1c4d5dd11e38 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:25.839399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 553/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:25 2022] GET /identity/v3/role_assignments?user.id=13d7d7170b954fbca5095ac365d0c0aa&scope.project.id=41ac10ea321b4087b263ccb79c327e2d&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:28.062052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6483-25e1-48f5-ba13-e4327f5a0142 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:28.062561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6483-25e1-48f5-ba13-e4327f5a0142 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:28.062671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6483-25e1-48f5-ba13-e4327f5a0142 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:28.063968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 565/1118] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:28.069750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509efd0-ac8b-4d42-b3dc-2afb60ec8aa5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:28.070156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509efd0-ac8b-4d42-b3dc-2afb60ec8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:28.070291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509efd0-ac8b-4d42-b3dc-2afb60ec8aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:28.086168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1509efd0-ac8b-4d42-b3dc-2afb60ec8aa5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:28.087331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1509efd0-ac8b-4d42-b3dc-2afb60ec8aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:28.148859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 554/1119] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:28.170639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d6483-25e1-48f5-ba13-e4327f5a0142 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:28.268616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d6483-25e1-48f5-ba13-e4327f5a0142 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:28.299901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:28.300729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:28.301005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:28.301274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] PATH_INFO: `/v3/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:28.302743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] RBAC: Authorizing `identity:get_role(role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:28.304103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:28.305447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 566/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:28 2022] GET /identity/v3/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:28.311635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509efd0-ac8b-4d42-b3dc-2afb60ec8aa5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:28.403119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509efd0-ac8b-4d42-b3dc-2afb60ec8aa5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:28.436242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:28.437365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:28.437671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:28.437943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] PATH_INFO: `/v3/users/13d7d7170b954fbca5095ac365d0c0aa` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:28.439100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] RBAC: Authorizing `identity:get_user(user_id=13d7d7170b954fbca5095ac365d0c0aa)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:28.440580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:28.442206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 555/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:28 2022] GET /identity/v3/users/13d7d7170b954fbca5095ac365d0c0aa => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:28.448233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:28.560805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd3344-7412-46b8-a6ab-8f5e4ef14174 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:28.593023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62911a-30fc-44f1-8b92-bf01cf2a9325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:28.593894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62911a-30fc-44f1-8b92-bf01cf2a9325 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:28.594171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62911a-30fc-44f1-8b92-bf01cf2a9325 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:28.594436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62911a-30fc-44f1-8b92-bf01cf2a9325 None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:28.595589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62911a-30fc-44f1-8b92-bf01cf2a9325 None admin] RBAC: Authorizing `identity:get_project(project_id=41ac10ea321b4087b263ccb79c327e2d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:28.597548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62911a-30fc-44f1-8b92-bf01cf2a9325 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:28.599230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 567/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:28 2022] GET /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:28.605302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:28.698053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f299a-1cd2-4f75-b73d-1769c243af06 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:28.729577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6fb4b-275a-4bef-82ae-7a4e0d932f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:28.730452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fb4b-275a-4bef-82ae-7a4e0d932f95 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:28.730724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fb4b-275a-4bef-82ae-7a4e0d932f95 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:28.730990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fb4b-275a-4bef-82ae-7a4e0d932f95 None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d/users/13d7d7170b954fbca5095ac365d0c0aa/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:28.733110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6fb4b-275a-4bef-82ae-7a4e0d932f95 None admin] RBAC: Authorizing `identity:create_grant(project_id=41ac10ea321b4087b263ccb79c327e2d, user_id=13d7d7170b954fbca5095ac365d0c0aa, role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:28.734540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6fb4b-275a-4bef-82ae-7a4e0d932f95 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:28.747332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 556/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:54:28 2022] PUT /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d/users/13d7d7170b954fbca5095ac365d0c0aa/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:54:31.006908 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dea6-8285-4c4e-a1fa-7efff515ae38 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:31.007373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dea6-8285-4c4e-a1fa-7efff515ae38 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:31.007467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dea6-8285-4c4e-a1fa-7efff515ae38 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:31.008809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 568/1124] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:31.013938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01de1-caca-44d8-b27e-7b00424757bf None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:31.014358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01de1-caca-44d8-b27e-7b00424757bf None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:31.014485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c01de1-caca-44d8-b27e-7b00424757bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:31.031279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c3c01de1-caca-44d8-b27e-7b00424757bf None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:31.032440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c3c01de1-caca-44d8-b27e-7b00424757bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:31.093889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 557/1125] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:31.117215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1dea6-8285-4c4e-a1fa-7efff515ae38 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:31.210748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1dea6-8285-4c4e-a1fa-7efff515ae38 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:31.241830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:31.242594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:31.242871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:31.243139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] PATH_INFO: `/v3/roles/54ebe31f997c46b1812c8a4cf568df77` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:31.244584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] RBAC: Authorizing `identity:get_role(role_id=54ebe31f997c46b1812c8a4cf568df77)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:31.245963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:31.247289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 569/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:31 2022] GET /identity/v3/roles/54ebe31f997c46b1812c8a4cf568df77 => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:31.253271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c01de1-caca-44d8-b27e-7b00424757bf None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:31.343160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c01de1-caca-44d8-b27e-7b00424757bf None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:31.374040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:31.374881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:31.375182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:31.375451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] PATH_INFO: `/v3/users/13d7d7170b954fbca5095ac365d0c0aa` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:31.376589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] RBAC: Authorizing `identity:get_user(user_id=13d7d7170b954fbca5095ac365d0c0aa)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:31.378048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:31.379606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 558/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:31 2022] GET /identity/v3/users/13d7d7170b954fbca5095ac365d0c0aa => generated 286 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:31.385003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:31.478539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249de0-d592-46ea-9b24-f8f013b3e067 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:31.509954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:31.510515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:31.510791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:31.511059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:31.572448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:31.573895 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:31.663810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 570/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:31.669507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:31.762961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406aa3f-e675-4bf6-aa64-9d2e6ef03596 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:31.794696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e8758-e713-4a6f-8254-f1b539029a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:31.795557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e8758-e713-4a6f-8254-f1b539029a50 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:31.795833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e8758-e713-4a6f-8254-f1b539029a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:31.796102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e8758-e713-4a6f-8254-f1b539029a50 None admin] PATH_INFO: `/v3/projects/41ac10ea321b4087b263ccb79c327e2d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:31.797243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e8758-e713-4a6f-8254-f1b539029a50 None admin] RBAC: Authorizing `identity:get_project(project_id=41ac10ea321b4087b263ccb79c327e2d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:31.798678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e8758-e713-4a6f-8254-f1b539029a50 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:31.800851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 559/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:31 2022] GET /identity/v3/projects/41ac10ea321b4087b263ccb79c327e2d => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:31.806791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:31.902121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3ce55-6784-447f-985c-982dbf900715 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:31.933914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e62e56-fd19-4bc8-868c-678f4eedcecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:31.934547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62e56-fd19-4bc8-868c-678f4eedcecd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:31.934818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62e56-fd19-4bc8-868c-678f4eedcecd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:31.935088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62e56-fd19-4bc8-868c-678f4eedcecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:31.935887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62e56-fd19-4bc8-868c-678f4eedcecd None admin] RBAC: Adding query filter params (role.id=54ebe31f997c46b1812c8a4cf568df77, scope.project.id=41ac10ea321b4087b263ccb79c327e2d, user.id=13d7d7170b954fbca5095ac365d0c0aa) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:31.936193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62e56-fd19-4bc8-868c-678f4eedcecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:31.937616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62e56-fd19-4bc8-868c-678f4eedcecd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:31.943648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 571/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:31 2022] GET /identity/v3/role_assignments?user.id=13d7d7170b954fbca5095ac365d0c0aa&scope.project.id=41ac10ea321b4087b263ccb79c327e2d&role.id=54ebe31f997c46b1812c8a4cf568df77 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:34.171141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69b2b-36ee-402a-aed6-ce7b6be819dd None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:34.171681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69b2b-36ee-402a-aed6-ce7b6be819dd None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:34.171681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69b2b-36ee-402a-aed6-ce7b6be819dd None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:34.173026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 560/1131] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:34.178152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1750-8428-4f95-a435-31fecb541dfe None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:34.178571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1750-8428-4f95-a435-31fecb541dfe None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:34.178672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1750-8428-4f95-a435-31fecb541dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:34.194595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2c9d1750-8428-4f95-a435-31fecb541dfe None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:34.195746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2c9d1750-8428-4f95-a435-31fecb541dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:34.257771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 572/1132] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:54:34.281290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e69b2b-36ee-402a-aed6-ce7b6be819dd None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:34.375950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e69b2b-36ee-402a-aed6-ce7b6be819dd None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:34.407730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8143d8-3814-4577-a8a2-598bb2e8b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:34.409117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8143d8-3814-4577-a8a2-598bb2e8b89e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:34.409397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8143d8-3814-4577-a8a2-598bb2e8b89e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:34.409703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8143d8-3814-4577-a8a2-598bb2e8b89e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:34.410866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8143d8-3814-4577-a8a2-598bb2e8b89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:34.412279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8143d8-3814-4577-a8a2-598bb2e8b89e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:34.413887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 561/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:34.419432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1750-8428-4f95-a435-31fecb541dfe None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:34.513558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1750-8428-4f95-a435-31fecb541dfe None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:34.544985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5440e3c-5e73-407e-a1d9-960ae422c41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:34.545658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440e3c-5e73-407e-a1d9-960ae422c41c None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:34.545935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440e3c-5e73-407e-a1d9-960ae422c41c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:34.546204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440e3c-5e73-407e-a1d9-960ae422c41c None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:34.546888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5440e3c-5e73-407e-a1d9-960ae422c41c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:34.548297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5440e3c-5e73-407e-a1d9-960ae422c41c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:34.571748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 573/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:54:34 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:36.803061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d6a1b-3b3a-4c4d-9534-6922bf26f65e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:36.803617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d6a1b-3b3a-4c4d-9534-6922bf26f65e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:36.803617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d6a1b-3b3a-4c4d-9534-6922bf26f65e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:36.804945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 562/1135] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:36.810063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b587-962a-47d0-b13c-91878efae0b3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:36.810497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b587-962a-47d0-b13c-91878efae0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:36.810622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b587-962a-47d0-b13c-91878efae0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:36.826727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ae99b587-962a-47d0-b13c-91878efae0b3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:36.827898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ae99b587-962a-47d0-b13c-91878efae0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:36.889299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 574/1136] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:36.914065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d6a1b-3b3a-4c4d-9534-6922bf26f65e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:37.008505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d6a1b-3b3a-4c4d-9534-6922bf26f65e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:37.041242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d62be2-8001-4022-a373-a2a90d1aec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:37.042046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d62be2-8001-4022-a373-a2a90d1aec29 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:37.042323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d62be2-8001-4022-a373-a2a90d1aec29 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:37.042587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d62be2-8001-4022-a373-a2a90d1aec29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:37.043826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d62be2-8001-4022-a373-a2a90d1aec29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:37.045249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d62be2-8001-4022-a373-a2a90d1aec29 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:37.046873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 563/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:54:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:37.052692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b587-962a-47d0-b13c-91878efae0b3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:37.143772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b587-962a-47d0-b13c-91878efae0b3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:37.175272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430d708-eebc-402f-b20d-48a1bc879c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:37.175915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430d708-eebc-402f-b20d-48a1bc879c23 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:37.176192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430d708-eebc-402f-b20d-48a1bc879c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:37.176461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430d708-eebc-402f-b20d-48a1bc879c23 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:37.177153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430d708-eebc-402f-b20d-48a1bc879c23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:37.178643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430d708-eebc-402f-b20d-48a1bc879c23 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:37.196356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 575/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:54:37 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:39.450245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40e122-6170-4fd8-93bb-ead87284a368 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:39.450902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40e122-6170-4fd8-93bb-ead87284a368 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:39.450902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40e122-6170-4fd8-93bb-ead87284a368 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:39.452139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 564/1139] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:39.457292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018df03-d8ef-4d05-9981-0b41678ae398 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:39.457717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018df03-d8ef-4d05-9981-0b41678ae398 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:39.457868 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018df03-d8ef-4d05-9981-0b41678ae398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:39.473867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c018df03-d8ef-4d05-9981-0b41678ae398 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:39.475023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c018df03-d8ef-4d05-9981-0b41678ae398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:39.536762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 576/1140] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:39.560957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40e122-6170-4fd8-93bb-ead87284a368 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:39.663362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40e122-6170-4fd8-93bb-ead87284a368 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:39.694720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:39.695494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:39.695773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:39.696045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:39.705506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:39.712890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:39.714071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:39.715169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 565/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:39.720079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018df03-d8ef-4d05-9981-0b41678ae398 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:39.811463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018df03-d8ef-4d05-9981-0b41678ae398 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:39.842655 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:39.843296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:39.843566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:39.843830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:39.844547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:39.844842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:39.846701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:39.854153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 577/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:54:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:39.859673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:39.957882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eecf2-611a-4f9c-b774-a83b2fd0503c None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:39.990490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:39.991352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:39.991633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:39.991905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] PATH_INFO: `/v3/users/f680e8ae124d438cb3a55c98fea33e4b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:40.004393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] RBAC: Authorizing `identity:get_user(user_id=f680e8ae124d438cb3a55c98fea33e4b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:40.005849 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:40.007487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 566/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:39 2022] GET /identity/v3/users/f680e8ae124d438cb3a55c98fea33e4b => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:40.013205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:40.106492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e881-8e1e-4a38-9f52-b15dfa8dbc65 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:40.136820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:40.137445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:40.137754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:40.138028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:40.200889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:40.202355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:40.297172 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 578/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:40.304091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:40.396972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde013b-8982-4d2a-9cc0-f241b1905815 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:40.428839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f532d-4c19-4ff7-940b-f6eb4dfc51ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:40.429708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f532d-4c19-4ff7-940b-f6eb4dfc51ac None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:40.429990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f532d-4c19-4ff7-940b-f6eb4dfc51ac None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:40.430264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f532d-4c19-4ff7-940b-f6eb4dfc51ac None admin] PATH_INFO: `/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:40.431418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f532d-4c19-4ff7-940b-f6eb4dfc51ac None admin] RBAC: Authorizing `identity:get_project(project_id=3cd2ad36e0fe414cb2ae7832f144a024)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:40.432837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f532d-4c19-4ff7-940b-f6eb4dfc51ac None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:40.434541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 567/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:40 2022] GET /identity/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:40.441014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:40.535061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e629c-f438-40f5-9186-7717767d85db None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:40.566316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be193c-c263-4c1e-9ee1-6937484a91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:40.566887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be193c-c263-4c1e-9ee1-6937484a91e6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:40.567160 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be193c-c263-4c1e-9ee1-6937484a91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:40.567429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be193c-c263-4c1e-9ee1-6937484a91e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:40.568233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be193c-c263-4c1e-9ee1-6937484a91e6 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3cd2ad36e0fe414cb2ae7832f144a024, user.id=f680e8ae124d438cb3a55c98fea33e4b) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:40.568538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be193c-c263-4c1e-9ee1-6937484a91e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:40.569990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be193c-c263-4c1e-9ee1-6937484a91e6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:40.575495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 579/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:40 2022] GET /identity/v3/role_assignments?user.id=f680e8ae124d438cb3a55c98fea33e4b&scope.project.id=3cd2ad36e0fe414cb2ae7832f144a024&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:42.799320 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613671-edb6-450c-8e6d-e78c9b4b49b6 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:42.799903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613671-edb6-450c-8e6d-e78c9b4b49b6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:42.799903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613671-edb6-450c-8e6d-e78c9b4b49b6 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:42.801214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 568/1147] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:42.806623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190d823-75fe-4371-9a3b-1d3613caa669 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:42.807018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190d823-75fe-4371-9a3b-1d3613caa669 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:42.807176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190d823-75fe-4371-9a3b-1d3613caa669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:42.823437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4190d823-75fe-4371-9a3b-1d3613caa669 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:42.824610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4190d823-75fe-4371-9a3b-1d3613caa669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:42.886791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 580/1148] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:42.909893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60613671-edb6-450c-8e6d-e78c9b4b49b6 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:43.005258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60613671-edb6-450c-8e6d-e78c9b4b49b6 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:43.037828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:43.038606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:43.038885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:43.039155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:43.048659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:43.056202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:43.057214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:43.058183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 569/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:54:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:43.063497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190d823-75fe-4371-9a3b-1d3613caa669 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:43.154723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190d823-75fe-4371-9a3b-1d3613caa669 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:43.186353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:43.186995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:43.187275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:43.187546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:43.188276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:43.188581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:43.190003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:43.197561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 581/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:43.204147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:43.297490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3cc73-eddf-4bfc-ae9a-c39b4743d41e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:43.328077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:43.328867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:43.329145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:43.329412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] PATH_INFO: `/v3/users/f680e8ae124d438cb3a55c98fea33e4b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:43.331121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] RBAC: Authorizing `identity:get_user(user_id=f680e8ae124d438cb3a55c98fea33e4b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:43.332525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:43.334148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 570/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:43 2022] GET /identity/v3/users/f680e8ae124d438cb3a55c98fea33e4b => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:43.339777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:43.432678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9a324-9654-4c7d-84d8-3efb458e8200 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:43.464099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c810c0-a708-4f80-8e2c-8ed789cc60d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:43.464925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c810c0-a708-4f80-8e2c-8ed789cc60d0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:43.465199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c810c0-a708-4f80-8e2c-8ed789cc60d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:43.465495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c810c0-a708-4f80-8e2c-8ed789cc60d0 None admin] PATH_INFO: `/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:43.466638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c810c0-a708-4f80-8e2c-8ed789cc60d0 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd2ad36e0fe414cb2ae7832f144a024)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:43.468052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c810c0-a708-4f80-8e2c-8ed789cc60d0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:43.469725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 582/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:43 2022] GET /identity/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:43.475379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:43.569246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b547f63-92c7-42e7-ad6d-e199be7d88d9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:43.601027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc034-bac1-4c13-95b9-8beed37e8287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:43.601876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc034-bac1-4c13-95b9-8beed37e8287 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:43.602154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc034-bac1-4c13-95b9-8beed37e8287 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:43.602424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc034-bac1-4c13-95b9-8beed37e8287 None admin] PATH_INFO: `/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024/users/f680e8ae124d438cb3a55c98fea33e4b/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:43.604372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc034-bac1-4c13-95b9-8beed37e8287 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd2ad36e0fe414cb2ae7832f144a024, user_id=f680e8ae124d438cb3a55c98fea33e4b, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:43.605814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc034-bac1-4c13-95b9-8beed37e8287 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:43.618868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 571/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:54:43 2022] PUT /identity/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024/users/f680e8ae124d438cb3a55c98fea33e4b/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:54:45.839988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d030a-8b02-43e5-b814-1a11fdc03ddd None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:45.840545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d030a-8b02-43e5-b814-1a11fdc03ddd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:45.840545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d030a-8b02-43e5-b814-1a11fdc03ddd None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:45.841935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 583/1154] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:45.847452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e219-0322-45c6-9f24-25cc8bed7991 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:45.847867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e219-0322-45c6-9f24-25cc8bed7991 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:45.848002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e219-0322-45c6-9f24-25cc8bed7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:45.864778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-dd10e219-0322-45c6-9f24-25cc8bed7991 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:45.865993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-dd10e219-0322-45c6-9f24-25cc8bed7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:45.928040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 572/1155] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:45.950972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d030a-8b02-43e5-b814-1a11fdc03ddd None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:46.046303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d030a-8b02-43e5-b814-1a11fdc03ddd None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:46.076466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:46.077234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:46.077537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:46.077805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:46.088109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:54:46.095585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:46.097104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:54:46.098039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 584/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:46.103210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e219-0322-45c6-9f24-25cc8bed7991 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:46.194544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e219-0322-45c6-9f24-25cc8bed7991 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:46.226646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:46.227290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:46.227567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:46.227837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:46.228561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:46.228863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:46.230226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:46.237845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 573/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:46.243198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:46.335704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032fbde-21ac-4346-827a-b73de47d2b7c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:46.367038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:46.367818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:46.368095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:46.368365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] PATH_INFO: `/v3/users/f680e8ae124d438cb3a55c98fea33e4b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:46.369549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] RBAC: Authorizing `identity:get_user(user_id=f680e8ae124d438cb3a55c98fea33e4b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:46.370955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:46.372533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 585/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:54:46 2022] GET /identity/v3/users/f680e8ae124d438cb3a55c98fea33e4b => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:46.378648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:46.473954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6cff3-0c86-422f-a1d0-8e5ece281f85 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:46.504822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:46.505453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:46.505760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:46.506033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:46.570726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:46.572154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:46.663102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 574/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:54:46.668865 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:46.761023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3da2d-5eec-492f-8e37-39e689d62afc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:46.792056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cef85-6b30-499a-9320-3cba93561113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:46.792888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cef85-6b30-499a-9320-3cba93561113 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:46.793163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cef85-6b30-499a-9320-3cba93561113 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:46.793434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cef85-6b30-499a-9320-3cba93561113 None admin] PATH_INFO: `/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:46.794612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cef85-6b30-499a-9320-3cba93561113 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd2ad36e0fe414cb2ae7832f144a024)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:46.796017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cef85-6b30-499a-9320-3cba93561113 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:46.797709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 586/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:54:46 2022] GET /identity/v3/projects/3cd2ad36e0fe414cb2ae7832f144a024 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:46.803955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:46.895844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f3955-a93f-45c9-aa95-30b30a4a3a95 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:46.927175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0257da-448a-488e-b43c-49ffb1678795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:46.927757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0257da-448a-488e-b43c-49ffb1678795 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:46.928037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0257da-448a-488e-b43c-49ffb1678795 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:46.928311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0257da-448a-488e-b43c-49ffb1678795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:46.929113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0257da-448a-488e-b43c-49ffb1678795 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3cd2ad36e0fe414cb2ae7832f144a024, user.id=f680e8ae124d438cb3a55c98fea33e4b) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:46.929421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0257da-448a-488e-b43c-49ffb1678795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:46.930866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0257da-448a-488e-b43c-49ffb1678795 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:46.936361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 575/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:54:46 2022] GET /identity/v3/role_assignments?user.id=f680e8ae124d438cb3a55c98fea33e4b&scope.project.id=3cd2ad36e0fe414cb2ae7832f144a024&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:49.158125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872682-4a4a-4613-9e9e-fa46ff9d18b1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:49.158643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872682-4a4a-4613-9e9e-fa46ff9d18b1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:49.158643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872682-4a4a-4613-9e9e-fa46ff9d18b1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:49.160548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 587/1162] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:49.165656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3d171-ce5f-454e-896e-a988e5704b57 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:49.166062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3d171-ce5f-454e-896e-a988e5704b57 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:49.166210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3d171-ce5f-454e-896e-a988e5704b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:49.182729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-dac3d171-ce5f-454e-896e-a988e5704b57 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:49.183890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-dac3d171-ce5f-454e-896e-a988e5704b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:49.245707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 576/1163] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:49.268147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c872682-4a4a-4613-9e9e-fa46ff9d18b1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:49.360127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c872682-4a4a-4613-9e9e-fa46ff9d18b1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:49.391505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:49.392119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:49.392392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:49.392659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:49.453904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:49.455323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:49.547637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 588/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:54:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:54:49.554215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3d171-ce5f-454e-896e-a988e5704b57 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:49.645267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3d171-ce5f-454e-896e-a988e5704b57 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:49.677109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe3f60-5a18-4e5f-9b4a-81ef6622d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:49.678032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe3f60-5a18-4e5f-9b4a-81ef6622d96f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:49.678313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe3f60-5a18-4e5f-9b4a-81ef6622d96f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:49.678585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe3f60-5a18-4e5f-9b4a-81ef6622d96f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:49.684854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe3f60-5a18-4e5f-9b4a-81ef6622d96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:49.686306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe3f60-5a18-4e5f-9b4a-81ef6622d96f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-2bbe3f60-5a18-4e5f-9b4a-81ef6622d96f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:54:49.699835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:54:49.701009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:54:49.701925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 577/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:54:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:54:49.706781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:49.798182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db007-9e12-4ef0-860c-293143cb23db None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:49.828815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963592b-c8bc-4e2f-ba60-f8f6aaf5976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:49.829450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963592b-c8bc-4e2f-ba60-f8f6aaf5976e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:49.829756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963592b-c8bc-4e2f-ba60-f8f6aaf5976e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:49.830025 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963592b-c8bc-4e2f-ba60-f8f6aaf5976e None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:49.831238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963592b-c8bc-4e2f-ba60-f8f6aaf5976e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:54:49.831537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963592b-c8bc-4e2f-ba60-f8f6aaf5976e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:49.832885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963592b-c8bc-4e2f-ba60-f8f6aaf5976e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:49.839611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 589/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 18:54:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:52.053005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420544-add7-48f8-93ce-2afe5da4f8b1 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:52.053455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420544-add7-48f8-93ce-2afe5da4f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:52.053573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420544-add7-48f8-93ce-2afe5da4f8b1 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:52.054950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 578/1167] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:52.059980 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daf648-8306-4711-b4eb-115f616c39d7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:52.060387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daf648-8306-4711-b4eb-115f616c39d7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:52.060523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daf648-8306-4711-b4eb-115f616c39d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:52.077279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-19daf648-8306-4711-b4eb-115f616c39d7 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:52.078473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-19daf648-8306-4711-b4eb-115f616c39d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:52.140095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 590/1168] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:52.163377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420544-add7-48f8-93ce-2afe5da4f8b1 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:52.259471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420544-add7-48f8-93ce-2afe5da4f8b1 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:52.290578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af1d6-2d0a-4d62-83a6-46c0bb0929bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:52.291218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af1d6-2d0a-4d62-83a6-46c0bb0929bf None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:52.291499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af1d6-2d0a-4d62-83a6-46c0bb0929bf None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:52.291772 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af1d6-2d0a-4d62-83a6-46c0bb0929bf None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:52.292503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af1d6-2d0a-4d62-83a6-46c0bb0929bf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:52.293914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af1d6-2d0a-4d62-83a6-46c0bb0929bf None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:52.308215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 579/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Wed May 4 18:54:52 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:54.583009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5be89-5e1f-43b9-8a95-2e407fdaf90a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:54.583878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5be89-5e1f-43b9-8a95-2e407fdaf90a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:54.583878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5be89-5e1f-43b9-8a95-2e407fdaf90a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:54.584920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 591/1170] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:54.591383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d873-d7dd-4cea-98a5-fc44b9f7991e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:54.591795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d873-d7dd-4cea-98a5-fc44b9f7991e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:54.591930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d873-d7dd-4cea-98a5-fc44b9f7991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:54.608533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c375d873-d7dd-4cea-98a5-fc44b9f7991e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:54.609725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c375d873-d7dd-4cea-98a5-fc44b9f7991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:54.671804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 580/1171] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:54.695373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5be89-5e1f-43b9-8a95-2e407fdaf90a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:54.792019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5be89-5e1f-43b9-8a95-2e407fdaf90a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:54.823216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132e7db-c4a7-42be-ad7e-4889f9e47bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:54.824067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132e7db-c4a7-42be-ad7e-4889f9e47bca None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:54.824341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132e7db-c4a7-42be-ad7e-4889f9e47bca None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:54.824609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132e7db-c4a7-42be-ad7e-4889f9e47bca None admin] PATH_INFO: `/v3/domains/773746ce067040b59d358cd86522d579` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:54.835059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132e7db-c4a7-42be-ad7e-4889f9e47bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=773746ce067040b59d358cd86522d579)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:54.836419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132e7db-c4a7-42be-ad7e-4889f9e47bca None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:54.838031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 592/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Wed May 4 18:54:54 2022] GET /identity/v3/domains/773746ce067040b59d358cd86522d579 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:54.843638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d873-d7dd-4cea-98a5-fc44b9f7991e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:54.933175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d873-d7dd-4cea-98a5-fc44b9f7991e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:54.965539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e717-8d66-47b5-a23a-24ca3684a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:54.966177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e717-8d66-47b5-a23a-24ca3684a8cf None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:54.966453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e717-8d66-47b5-a23a-24ca3684a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:54.966721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e717-8d66-47b5-a23a-24ca3684a8cf None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:54.967414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902e717-8d66-47b5-a23a-24ca3684a8cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:54.968828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902e717-8d66-47b5-a23a-24ca3684a8cf None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:54.992968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 581/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:54:54 2022] POST /identity/v3/projects => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:54:57.256291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d790-622f-495a-bc18-557168ada8d3 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:57.256801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d790-622f-495a-bc18-557168ada8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:57.256801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d790-622f-495a-bc18-557168ada8d3 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:57.258142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 593/1174] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:57.263264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6329-ad47-4cb3-9ed9-57441562ad8e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:57.263650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6329-ad47-4cb3-9ed9-57441562ad8e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:57.263809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6329-ad47-4cb3-9ed9-57441562ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:57.280479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-69aa6329-ad47-4cb3-9ed9-57441562ad8e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:57.281674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-69aa6329-ad47-4cb3-9ed9-57441562ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:57.346638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 582/1175] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:54:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:54:57.371102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15d790-622f-495a-bc18-557168ada8d3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:57.465203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15d790-622f-495a-bc18-557168ada8d3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:57.496010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a7548-8a2b-4088-a1c0-d60e55aa0b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:57.496847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a7548-8a2b-4088-a1c0-d60e55aa0b90 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:57.497124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a7548-8a2b-4088-a1c0-d60e55aa0b90 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:57.497396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a7548-8a2b-4088-a1c0-d60e55aa0b90 None admin] PATH_INFO: `/v3/domains/773746ce067040b59d358cd86522d579` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:57.498581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a7548-8a2b-4088-a1c0-d60e55aa0b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=773746ce067040b59d358cd86522d579)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:57.499985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a7548-8a2b-4088-a1c0-d60e55aa0b90 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:57.501710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 594/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Wed May 4 18:54:57 2022] GET /identity/v3/domains/773746ce067040b59d358cd86522d579 => generated 267 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:57.507204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6329-ad47-4cb3-9ed9-57441562ad8e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:57.607726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6329-ad47-4cb3-9ed9-57441562ad8e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:57.650337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f827-9092-4e58-bf61-a6fd702e100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:57.650990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f827-9092-4e58-bf61-a6fd702e100c None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:57.651307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f827-9092-4e58-bf61-a6fd702e100c None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:57.651659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f827-9092-4e58-bf61-a6fd702e100c None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:57.652344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f827-9092-4e58-bf61-a6fd702e100c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:57.654316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f827-9092-4e58-bf61-a6fd702e100c None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:57.675637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 583/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:54:57 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:55:00.003154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c460-1588-421e-bcc8-337da06bbbe5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:00.003581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c460-1588-421e-bcc8-337da06bbbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:00.003677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c460-1588-421e-bcc8-337da06bbbe5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:00.005060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 595/1178] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:00.010178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56682c-2370-4623-bbd3-3022d016af2b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:00.010615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56682c-2370-4623-bbd3-3022d016af2b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:00.010717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56682c-2370-4623-bbd3-3022d016af2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:00.027052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4c56682c-2370-4623-bbd3-3022d016af2b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:00.028201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4c56682c-2370-4623-bbd3-3022d016af2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:00.095177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 584/1179] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:55:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:55:00.120140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c460-1588-421e-bcc8-337da06bbbe5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:00.213549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c460-1588-421e-bcc8-337da06bbbe5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:00.244606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:00.245310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:00.245623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:00.245889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:00.256330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:55:00.263753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:55:00.264990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:55:00.266093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 596/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:55:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:55:00.271632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56682c-2370-4623-bbd3-3022d016af2b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:00.372400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56682c-2370-4623-bbd3-3022d016af2b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:00.406007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:00.406664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:00.406944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:00.407215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:00.407945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:55:00.408247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:00.410278 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:00.417852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 585/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:55:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:00.423601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:00.515421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57afa87-6289-443f-8197-1dcef37119a8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:00.547665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:00.548513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:00.548790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:00.549057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] PATH_INFO: `/v3/users/7255708ce0f84f7ea1e3ba9d905d03f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:00.561216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] RBAC: Authorizing `identity:get_user(user_id=7255708ce0f84f7ea1e3ba9d905d03f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:00.562689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:00.564295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 597/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:55:00 2022] GET /identity/v3/users/7255708ce0f84f7ea1e3ba9d905d03f0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:00.569827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:00.671249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1786-962b-4b51-8221-7c7e5cdab39b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:00.705916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:00.706557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:00.706837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:00.707108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:00.769487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:00.771138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:00.861766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 586/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:55:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:55:00.867664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:00.961017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a76be-0629-4aba-b393-6ed59ed1afe1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:00.993579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a8dd-cd9f-42dd-9fbd-679774696d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:00.994416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a8dd-cd9f-42dd-9fbd-679774696d58 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:00.994688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a8dd-cd9f-42dd-9fbd-679774696d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:00.994953 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a8dd-cd9f-42dd-9fbd-679774696d58 None admin] PATH_INFO: `/v3/projects/a3786f888a16436e8de21a1ac9e21fa5` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:00.996083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a8dd-cd9f-42dd-9fbd-679774696d58 None admin] RBAC: Authorizing `identity:get_project(project_id=a3786f888a16436e8de21a1ac9e21fa5)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:00.997509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a8dd-cd9f-42dd-9fbd-679774696d58 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:00.999177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 598/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:55:00 2022] GET /identity/v3/projects/a3786f888a16436e8de21a1ac9e21fa5 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:01.005921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:01.097272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623a27-40aa-4453-95ed-a75a0b244a2f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:01.141324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482a2af-255d-4fab-bf0c-7a1b7dccbca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:01.142055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482a2af-255d-4fab-bf0c-7a1b7dccbca4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:01.142333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482a2af-255d-4fab-bf0c-7a1b7dccbca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:01.142601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482a2af-255d-4fab-bf0c-7a1b7dccbca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:01.143427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482a2af-255d-4fab-bf0c-7a1b7dccbca4 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=a3786f888a16436e8de21a1ac9e21fa5, user.id=7255708ce0f84f7ea1e3ba9d905d03f0) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:55:01.143737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482a2af-255d-4fab-bf0c-7a1b7dccbca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:01.145419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482a2af-255d-4fab-bf0c-7a1b7dccbca4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:01.150902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 587/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:55:01 2022] GET /identity/v3/role_assignments?user.id=7255708ce0f84f7ea1e3ba9d905d03f0&scope.project.id=a3786f888a16436e8de21a1ac9e21fa5&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:03.358759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa25eca-e4a4-4db0-93e0-2b841947f930 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:03.359304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa25eca-e4a4-4db0-93e0-2b841947f930 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:03.359304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa25eca-e4a4-4db0-93e0-2b841947f930 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:03.360677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 599/1186] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:03.365940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5ad4-181c-4d74-b1ca-580c68e68cdf None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:03.366350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5ad4-181c-4d74-b1ca-580c68e68cdf None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:03.366492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5ad4-181c-4d74-b1ca-580c68e68cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:03.382497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-61df5ad4-181c-4d74-b1ca-580c68e68cdf None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:03.383661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-61df5ad4-181c-4d74-b1ca-580c68e68cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:03.445623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 588/1187] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:55:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:55:03.467757 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa25eca-e4a4-4db0-93e0-2b841947f930 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:03.562532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa25eca-e4a4-4db0-93e0-2b841947f930 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:03.594077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:03.594840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:03.595116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:03.595384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:03.605389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:55:03.613006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:55:03.614128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:55:03.615015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 600/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:55:03.619975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df5ad4-181c-4d74-b1ca-580c68e68cdf None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:03.712468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df5ad4-181c-4d74-b1ca-580c68e68cdf None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:03.743243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:03.743888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:03.744167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:03.744439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:03.745166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:55:03.745489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:03.746847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:03.754920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 589/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:55:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:03.761225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:03.854195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad9ba4-9091-45f0-b70d-511b2060c111 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:03.885188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:03.886014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:03.886294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:03.886565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] PATH_INFO: `/v3/users/7255708ce0f84f7ea1e3ba9d905d03f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:03.887727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] RBAC: Authorizing `identity:get_user(user_id=7255708ce0f84f7ea1e3ba9d905d03f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:03.889145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:03.890761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 601/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:55:03 2022] GET /identity/v3/users/7255708ce0f84f7ea1e3ba9d905d03f0 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:03.897101 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:03.990359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ddb36-f36a-4d6e-98ad-fd03906d836b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:04.021880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa2a80-531b-454b-b0b1-37cb63edc09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:04.022733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2a80-531b-454b-b0b1-37cb63edc09b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:04.023013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2a80-531b-454b-b0b1-37cb63edc09b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:04.023287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2a80-531b-454b-b0b1-37cb63edc09b None admin] PATH_INFO: `/v3/projects/a3786f888a16436e8de21a1ac9e21fa5` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:04.024439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa2a80-531b-454b-b0b1-37cb63edc09b None admin] RBAC: Authorizing `identity:get_project(project_id=a3786f888a16436e8de21a1ac9e21fa5)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:04.026000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa2a80-531b-454b-b0b1-37cb63edc09b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:04.027684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 590/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:55:03 2022] GET /identity/v3/projects/a3786f888a16436e8de21a1ac9e21fa5 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:04.033405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:04.125677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991a7d-7a97-4803-8a16-9f0dc0ac339f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:04.157078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0a2e-1700-4c30-93c8-439e2760925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:04.157918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0a2e-1700-4c30-93c8-439e2760925b None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:04.158222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0a2e-1700-4c30-93c8-439e2760925b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:04.158494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0a2e-1700-4c30-93c8-439e2760925b None admin] PATH_INFO: `/v3/projects/a3786f888a16436e8de21a1ac9e21fa5/users/7255708ce0f84f7ea1e3ba9d905d03f0/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:04.160409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0a2e-1700-4c30-93c8-439e2760925b None admin] RBAC: Authorizing `identity:create_grant(project_id=a3786f888a16436e8de21a1ac9e21fa5, user_id=7255708ce0f84f7ea1e3ba9d905d03f0, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:04.161856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0a2e-1700-4c30-93c8-439e2760925b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:04.174529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 602/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:55:04 2022] PUT /identity/v3/projects/a3786f888a16436e8de21a1ac9e21fa5/users/7255708ce0f84f7ea1e3ba9d905d03f0/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:55:06.360832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa912c3-f89c-42f5-9e80-b7868238fd6e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:06.361359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa912c3-f89c-42f5-9e80-b7868238fd6e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:06.361359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa912c3-f89c-42f5-9e80-b7868238fd6e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:06.362767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 591/1193] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:06.367807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd82422-92fc-45e1-947c-8fb4336ebbb4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:06.368184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd82422-92fc-45e1-947c-8fb4336ebbb4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:06.368347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd82422-92fc-45e1-947c-8fb4336ebbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:06.385086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bbd82422-92fc-45e1-947c-8fb4336ebbb4 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:06.386293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bbd82422-92fc-45e1-947c-8fb4336ebbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:06.447354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 603/1194] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:55:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:55:06.470481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa912c3-f89c-42f5-9e80-b7868238fd6e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:06.565567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa912c3-f89c-42f5-9e80-b7868238fd6e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:06.598168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:06.598932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:06.599212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:06.599486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:06.609095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:55:06.616861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:55:06.617955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:55:06.618973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 592/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:55:06.623666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd82422-92fc-45e1-947c-8fb4336ebbb4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:06.715489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd82422-92fc-45e1-947c-8fb4336ebbb4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:06.746103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:06.746750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:06.747026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:06.747297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:06.748021 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:55:06.748321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:06.749708 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:06.757763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 604/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:55:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:06.763586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:06.857002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d1c31-8c88-43c9-acd0-86a07cc5eaa4 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:06.888475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:06.889269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:06.889575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:06.889851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] PATH_INFO: `/v3/users/7255708ce0f84f7ea1e3ba9d905d03f0` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:06.891016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] RBAC: Authorizing `identity:get_user(user_id=7255708ce0f84f7ea1e3ba9d905d03f0)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:06.893005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:06.894630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 593/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 18:55:06 2022] GET /identity/v3/users/7255708ce0f84f7ea1e3ba9d905d03f0 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:06.900348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:06.992275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a7c-03a0-4a93-a7ed-13e03164b188 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:07.023642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:07.024265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:07.024544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:07.024811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:07.087697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:07.089113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:07.178639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 605/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:55:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:55:07.184374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:07.279231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbec46a-2bc2-4ab7-84ca-0f442ffb3043 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:07.310175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20008c-770d-4c84-88ac-4f9b162e4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:07.311094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20008c-770d-4c84-88ac-4f9b162e4202 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:07.311373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20008c-770d-4c84-88ac-4f9b162e4202 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:07.311643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20008c-770d-4c84-88ac-4f9b162e4202 None admin] PATH_INFO: `/v3/projects/a3786f888a16436e8de21a1ac9e21fa5` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:07.312816 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20008c-770d-4c84-88ac-4f9b162e4202 None admin] RBAC: Authorizing `identity:get_project(project_id=a3786f888a16436e8de21a1ac9e21fa5)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:07.314274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20008c-770d-4c84-88ac-4f9b162e4202 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:07.316460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 594/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 18:55:07 2022] GET /identity/v3/projects/a3786f888a16436e8de21a1ac9e21fa5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:55:07.322426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:07.412674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d8591-b1e1-49f1-bf38-0422cecd9152 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:07.444729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3868d33-0fe9-4347-ba03-0e1127f60805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:07.445301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3868d33-0fe9-4347-ba03-0e1127f60805 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:07.445608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3868d33-0fe9-4347-ba03-0e1127f60805 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:07.445880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3868d33-0fe9-4347-ba03-0e1127f60805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:07.446689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3868d33-0fe9-4347-ba03-0e1127f60805 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=a3786f888a16436e8de21a1ac9e21fa5, user.id=7255708ce0f84f7ea1e3ba9d905d03f0) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:55:07.446993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3868d33-0fe9-4347-ba03-0e1127f60805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:07.448405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3868d33-0fe9-4347-ba03-0e1127f60805 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:07.453942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 606/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:55:07 2022] GET /identity/v3/role_assignments?user.id=7255708ce0f84f7ea1e3ba9d905d03f0&scope.project.id=a3786f888a16436e8de21a1ac9e21fa5&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:08.378183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba92b7-af81-4a74-81ab-ee93bff3a0c8 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:08.378788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba92b7-af81-4a74-81ab-ee93bff3a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:08.378788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba92b7-af81-4a74-81ab-ee93bff3a0c8 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:08.380472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 595/1201] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:08.386096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37cda1-3334-4a17-b4ef-5f63832c43ad None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:08.386555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37cda1-3334-4a17-b4ef-5f63832c43ad None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:08.386766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37cda1-3334-4a17-b4ef-5f63832c43ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:08.407317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-eb37cda1-3334-4a17-b4ef-5f63832c43ad None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:08.408559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-eb37cda1-3334-4a17-b4ef-5f63832c43ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:08.488298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 607/1202] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:56:08.513918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba92b7-af81-4a74-81ab-ee93bff3a0c8 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:08.628823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba92b7-af81-4a74-81ab-ee93bff3a0c8 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:08.669435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:08.670312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:08.670650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:08.670925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:08.682010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:08.683623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:08.715184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:08.716692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:08.717748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:08.717748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:08.717748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:08.717748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:08.717748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 596/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:08.721276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37cda1-3334-4a17-b4ef-5f63832c43ad None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:08.852762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37cda1-3334-4a17-b4ef-5f63832c43ad None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:08.892105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfe591-f124-4aae-90e8-51b7199f47d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:08.892769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfe591-f124-4aae-90e8-51b7199f47d6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:08.893115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfe591-f124-4aae-90e8-51b7199f47d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:08.893345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfe591-f124-4aae-90e8-51b7199f47d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:08.894163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfe591-f124-4aae-90e8-51b7199f47d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:08.894475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfe591-f124-4aae-90e8-51b7199f47d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:08.896224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfe591-f124-4aae-90e8-51b7199f47d6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:08.913534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 608/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:08.917763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:09.041103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c2ee-2fe4-4e22-ba69-157baaccaf83 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:09.089092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff1fd-f80c-494a-8c99-3f5ef8ad07f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:09.090138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff1fd-f80c-494a-8c99-3f5ef8ad07f6 None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:09.090407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff1fd-f80c-494a-8c99-3f5ef8ad07f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:09.090692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff1fd-f80c-494a-8c99-3f5ef8ad07f6 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:09.091441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff1fd-f80c-494a-8c99-3f5ef8ad07f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:09.093022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff1fd-f80c-494a-8c99-3f5ef8ad07f6 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:09.120090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 597/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 18:56:08 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:11.676969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dca32-c76d-4fc5-a6d5-9b39f000b73c None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:11.677573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dca32-c76d-4fc5-a6d5-9b39f000b73c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:11.677573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dca32-c76d-4fc5-a6d5-9b39f000b73c None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:11.679216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 609/1206] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:11.684523 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2670-327f-4b84-81fe-c684918e4b93 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:11.684989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2670-327f-4b84-81fe-c684918e4b93 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:11.685102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2670-327f-4b84-81fe-c684918e4b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:11.703475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b13c2670-327f-4b84-81fe-c684918e4b93 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:11.704725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b13c2670-327f-4b84-81fe-c684918e4b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:11.776300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 598/1207] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:56:11.801931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dca32-c76d-4fc5-a6d5-9b39f000b73c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:11.917259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dca32-c76d-4fc5-a6d5-9b39f000b73c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:11.954558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:11.955305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:11.955588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:11.955859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:11.970099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:56:11.978588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:11.979735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:11.980617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 610/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:56:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:11.986759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c2670-327f-4b84-81fe-c684918e4b93 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:12.105722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c2670-327f-4b84-81fe-c684918e4b93 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:12.145858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:12.146575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:12.146883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:12.147187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:12.147962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:12.148270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:12.149789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:12.161648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 599/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:56:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:12.165439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:12.278518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebe468-9fd6-4c9d-9ef0-5e08e6a47e1f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:12.321494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:12.322684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:12.322969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:12.323272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:12.335381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:12.337103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:12.358165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:12.359943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:12.360866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:12.360866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:12.360866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:12.360866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:12.360866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 611/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:12.366261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:12.478585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7f71d-df54-475d-8b68-0a528743306a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:12.524118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:12.525151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:12.525355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:12.525871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:12.527234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:12.527806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:12.529726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:12.542522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 600/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:12.550360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:12.661874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b682c-fca9-47c2-b283-0b60b698b1ff None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:12.699049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:12.699930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:12.700211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:12.700584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:12.710154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:12.711883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:56:12.729298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:12.730459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:12.731434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 612/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:12.736958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:12.840857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de532488-986b-4703-85a5-daf3815e1145 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:12.890612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:12.891732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:12.891856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:12.892140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:12.892983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:12.893288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:12.895880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:12.915845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 601/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 18:56:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:56:12.922469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:13.042707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac210c6-78c3-421a-8dbc-9944898a1592 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:13.076401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:13.077046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:13.077845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:13.078119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:13.154457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:13.156394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:13.283876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 613/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:56:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:56:13.285133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:13.400184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09412-0f43-478c-a841-89bb5271980a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:13.443535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:13.444312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:13.444617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:13.445022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:13.458043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:13.459501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:13.480810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:13.481882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:13.487954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:13.487954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:13.487954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:13.487954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:13.487954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 602/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:13.489510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:13.594734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12cd7-1d17-44bc-a0f3-bd477ca6567a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:13.632166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:13.632882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:13.633160 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:13.633429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:13.634363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:13.634622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:13.636156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:13.649244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 614/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:56:13.657928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:13.765892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1830e-7d67-4408-be19-31dec7ca72ab None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:13.802186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:13.802983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:13.803256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:13.803530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:13.810324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:13.812425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:56:13.826527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:13.827667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:13.828722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 603/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:56:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:13.833674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:13.948649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f66c7-0576-417f-9200-1e52f07e265b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:13.991030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b1e72-54c8-487f-9184-5bf3c428d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:13.991734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1e72-54c8-487f-9184-5bf3c428d75f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:13.992043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1e72-54c8-487f-9184-5bf3c428d75f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:13.992305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1e72-54c8-487f-9184-5bf3c428d75f None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:13.993156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b1e72-54c8-487f-9184-5bf3c428d75f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:13.993580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b1e72-54c8-487f-9184-5bf3c428d75f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:13.995162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b1e72-54c8-487f-9184-5bf3c428d75f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:14.008697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 615/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:56:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:56:14.014743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:14.120969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377117-db38-405d-a741-96aadb6f12fc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:14.160066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7408-cba4-4ede-8ca0-c95d7f9455a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:14.160747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7408-cba4-4ede-8ca0-c95d7f9455a7 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:14.161031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7408-cba4-4ede-8ca0-c95d7f9455a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:14.161326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7408-cba4-4ede-8ca0-c95d7f9455a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:14.162189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7408-cba4-4ede-8ca0-c95d7f9455a7 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=4eba1582c17e4df991452d433cbe567b) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:14.162503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7408-cba4-4ede-8ca0-c95d7f9455a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:14.163922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7408-cba4-4ede-8ca0-c95d7f9455a7 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:14.169781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 604/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:56:14 2022] GET /identity/v3/role_assignments?user.id=4eba1582c17e4df991452d433cbe567b&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:16.547551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2ee4-3b82-42d4-bc9c-12d50d9cb9d9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:16.548157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2ee4-3b82-42d4-bc9c-12d50d9cb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:16.548157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2ee4-3b82-42d4-bc9c-12d50d9cb9d9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:16.549480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 616/1220] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:16.555972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06115116-a3fe-48c9-8067-28c8d2da4a7d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:16.556418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06115116-a3fe-48c9-8067-28c8d2da4a7d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:16.556567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06115116-a3fe-48c9-8067-28c8d2da4a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:16.578145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-06115116-a3fe-48c9-8067-28c8d2da4a7d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:16.579518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-06115116-a3fe-48c9-8067-28c8d2da4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:16.657012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 605/1221] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:56:16.684350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2ee4-3b82-42d4-bc9c-12d50d9cb9d9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:16.793956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2ee4-3b82-42d4-bc9c-12d50d9cb9d9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:16.829356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:16.830103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:16.830377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:16.830644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:16.843278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:56:16.851266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:16.852481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:16.853327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 617/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:56:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:16.861430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06115116-a3fe-48c9-8067-28c8d2da4a7d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:16.973482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06115116-a3fe-48c9-8067-28c8d2da4a7d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:17.011703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:17.012515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:17.012925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:17.013217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:17.014229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] RBAC: Adding query filter params (name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:17.014671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:17.016249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:17.026572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 606/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:56:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:56:17.032502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:17.143861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657dd9d-0d58-455b-997b-e0212ea79b40 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:17.191372 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:17.192324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:17.192602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:17.193006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:17.206077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:17.208360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:17.230921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:17.232014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:17.233115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:17.233115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:17.233115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:17.233115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:17.233115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 618/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:56:17.239460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:17.351811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cc29c-ca95-44f4-897c-8803656eb562 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:17.387807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:17.388788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:17.389200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:17.389670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:17.390598 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:17.391020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:17.392528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:17.405702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 607/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:17.411870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:17.524562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b0206-18b7-45aa-a9a6-dfe92afcf39d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:17.562858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:17.563794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:17.564012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:17.564324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:17.572426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:17.574009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:56:17.590409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:17.591489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:17.592427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 619/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:17.598363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:17.704718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3c9e-6265-4e25-9126-71c54d58ac4b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:17.745860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:17.746619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:17.746954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:17.747281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:17.748427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:17.748895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:17.750628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:17.775048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 608/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 18:56:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:17.781381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:17.896071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3117d-299f-456f-aaf1-1e5bb2d677b3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:17.933703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:17.934767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:17.935101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:17.935498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:17.947592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:17.949048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:17.967020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:17.968270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:17.969163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:17.969163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:17.969163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:17.969163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:17.969163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 620/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:17.974530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:18.074337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fad48-cb5f-4c0e-83d0-7ba59da593bc None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:18.112141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:18.112871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:18.113173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:18.113599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:18.114403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:18.114923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:18.116801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:18.130583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 609/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:56:18.136601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:18.245996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c86c-09a8-4e52-b4f2-c4a94ec60ed3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:18.281746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:18.282639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:18.282912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:18.283173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:18.290188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:18.292377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:56:18.313408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:18.314469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:18.315563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 621/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:56:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:56:18.322242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:18.429712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4013ca-5790-46d2-b7ca-ec28b23e9665 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:18.464239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c19a3-dd13-4216-94e0-8a686939ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:18.464984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c19a3-dd13-4216-94e0-8a686939ca6d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:18.465350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c19a3-dd13-4216-94e0-8a686939ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:18.465717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c19a3-dd13-4216-94e0-8a686939ca6d None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:18.466600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c19a3-dd13-4216-94e0-8a686939ca6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:18.467070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c19a3-dd13-4216-94e0-8a686939ca6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:18.468785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c19a3-dd13-4216-94e0-8a686939ca6d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:18.481183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 610/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:18.487679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:18.592040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660995-9625-436f-87d6-c11a701f2067 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:18.628408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4d43-5e3a-4dd4-9102-c108768a5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:18.629248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4d43-5e3a-4dd4-9102-c108768a5de1 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:18.629548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4d43-5e3a-4dd4-9102-c108768a5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:18.629821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4d43-5e3a-4dd4-9102-c108768a5de1 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/4eba1582c17e4df991452d433cbe567b/roles/2a60ba556fb14d54b12b57808444fca0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:18.644098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4d43-5e3a-4dd4-9102-c108768a5de1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=4eba1582c17e4df991452d433cbe567b, role_id=2a60ba556fb14d54b12b57808444fca0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:18.646014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4d43-5e3a-4dd4-9102-c108768a5de1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:18.660462 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 622/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:56:18 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/4eba1582c17e4df991452d433cbe567b/roles/2a60ba556fb14d54b12b57808444fca0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:21.216641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5a2c-4521-472e-85ce-f5b12ed72c8c None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:21.217196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5a2c-4521-472e-85ce-f5b12ed72c8c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:21.217196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5a2c-4521-472e-85ce-f5b12ed72c8c None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:21.218730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 611/1233] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:21.224797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9b54-450a-43a1-bc08-f8218a02b7fa None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:21.225240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9b54-450a-43a1-bc08-f8218a02b7fa None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:21.225240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9b54-450a-43a1-bc08-f8218a02b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:21.244407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-346b9b54-450a-43a1-bc08-f8218a02b7fa None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:21.245830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-346b9b54-450a-43a1-bc08-f8218a02b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:21.325288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 623/1234] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:56:21.349025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e5a2c-4521-472e-85ce-f5b12ed72c8c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:21.462406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e5a2c-4521-472e-85ce-f5b12ed72c8c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:21.497948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:21.498666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:21.499482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:21.499756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:21.510936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:56:21.519036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:21.520268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:21.521130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 612/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 18:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:21.526661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b9b54-450a-43a1-bc08-f8218a02b7fa None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:21.638835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b9b54-450a-43a1-bc08-f8218a02b7fa None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:21.673286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:21.673979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:21.674261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:21.674534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:21.675267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:21.675572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:21.676939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:21.685287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 624/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 18:56:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:21.691056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:21.796985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37e10-8cba-45ce-95bb-043ee31601e5 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:21.834229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:21.835020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:21.835291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:21.835557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:21.848495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:21.850238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:21.869615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:21.870788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:21.871939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:21.871939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:21.871939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:21.871939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:21.871939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 613/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:56:21.878817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:21.994981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2d453-ac9f-4205-9dee-a9ed80a26fa0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:22.036565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:22.037327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:22.037643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:22.037938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:22.039016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:22.039411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:22.041242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:22.053844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 625/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:22.059592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:22.168680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda490c-b0ac-41bf-b603-3fb4325d3de5 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:22.210255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:22.211058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:22.211332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:22.211600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:22.221249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:22.222983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:56:22.240602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:22.241907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:22.243237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 614/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:22.247792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:22.364790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011c8b9-a20d-4caf-987d-21a703393a24 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:22.405887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:22.406679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:22.407057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:22.407373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:22.408302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:22.408603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:22.410049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:22.427607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 626/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 18:56:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:22.433370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:22.534197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ad7ce-8ef1-44ce-a12b-dc98de3faa1a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:22.568882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:22.569588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:22.569915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:22.570191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:22.637194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:22.638624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:22.742936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 615/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:56:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:56:22.748946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:22.856574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182fba-d6a6-46d9-a983-1618181a6356 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:22.892346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:22.893047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:22.893321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:22.893617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:22.904756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:22.907079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:22.925827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:22.926763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:22.927673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:22.927673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:22.927673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:22.927673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:22.927673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 627/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:56:22.933247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:23.046501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b10dc5-dce2-422a-b940-b281d44fa65e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:23.082294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:23.082987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:23.083264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:23.083532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:23.084232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:23.084532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:23.085905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:23.097807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 616/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:23.103482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:23.205380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdc82-c1b8-4446-9cf5-a424a83b2798 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:23.238931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:23.239722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:23.239998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:23.240282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:23.246727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:23.248155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:56:23.262002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:23.263117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:23.264366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 628/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:56:23.269951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:23.382041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443668e-85f4-4931-b821-047bc9ad5e40 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:23.417764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d2ee0-6f33-4858-8c06-ed156eb2483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:23.418674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d2ee0-6f33-4858-8c06-ed156eb2483d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:23.418953 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d2ee0-6f33-4858-8c06-ed156eb2483d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:23.419232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d2ee0-6f33-4858-8c06-ed156eb2483d None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:23.420006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d2ee0-6f33-4858-8c06-ed156eb2483d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:23.420316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d2ee0-6f33-4858-8c06-ed156eb2483d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:23.421801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d2ee0-6f33-4858-8c06-ed156eb2483d None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:23.434669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 617/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:23.441262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:23.543948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089dc1d-2762-4002-9e41-e60ec7075c94 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:23.579801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28c916-e836-4a59-8432-42f057a20139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:23.580469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28c916-e836-4a59-8432-42f057a20139 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:23.580742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28c916-e836-4a59-8432-42f057a20139 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:23.581018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28c916-e836-4a59-8432-42f057a20139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:23.581860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28c916-e836-4a59-8432-42f057a20139 None admin] RBAC: Adding query filter params (role.id=2a60ba556fb14d54b12b57808444fca0, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=4eba1582c17e4df991452d433cbe567b) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:23.582178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28c916-e836-4a59-8432-42f057a20139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:23.585053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28c916-e836-4a59-8432-42f057a20139 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:23.593513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 629/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:56:23 2022] GET /identity/v3/role_assignments?user.id=4eba1582c17e4df991452d433cbe567b&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=2a60ba556fb14d54b12b57808444fca0 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:25.972023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1108c6-4722-471b-8abc-8247ca0fffd5 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:25.972732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1108c6-4722-471b-8abc-8247ca0fffd5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:25.972732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1108c6-4722-471b-8abc-8247ca0fffd5 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:25.975052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 618/1247] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:56:25.979275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32af26-ec76-4dc0-bd64-19baea930047 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:25.979753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32af26-ec76-4dc0-bd64-19baea930047 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:25.979939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32af26-ec76-4dc0-bd64-19baea930047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:25.996822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6d32af26-ec76-4dc0-bd64-19baea930047 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:25.998011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6d32af26-ec76-4dc0-bd64-19baea930047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:26.063264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 630/1248] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:56:26.086520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1108c6-4722-471b-8abc-8247ca0fffd5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:26.192555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1108c6-4722-471b-8abc-8247ca0fffd5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:26.229400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:26.230153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:26.230439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:26.230702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:26.241385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:56:26.248998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:26.250257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:26.251159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 619/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:26.256326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32af26-ec76-4dc0-bd64-19baea930047 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:26.364433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32af26-ec76-4dc0-bd64-19baea930047 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:26.403592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:26.404271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:26.404548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:26.405356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:26.406163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:26.406465 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:26.408033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:26.417196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 631/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:26.423518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:26.524458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75706-13ed-4479-900e-2f8101f2dca3 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:26.558406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:26.559202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:26.559475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:26.559739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:26.570635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:26.572110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:26.589936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:26.591028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:26.591951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:26.591951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:26.591951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:26.591951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:26.591951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 620/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:56:26.597579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:26.698038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f057067-3349-4b1d-b406-27167e65499b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:26.730594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:26.731251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:26.731528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:26.731799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:26.732508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:26.732814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:26.734232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:26.745856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 632/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:26.751305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:26.847955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23108462-759a-4a9c-bb0d-673b4a3d5db4 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:26.880292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:26.881096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:26.881376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:26.881675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:26.889012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:26.891013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:56:26.905240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:26.906371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:26.907342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 621/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:26.912174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:27.010690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aec282-84ee-4f77-aa0f-8065204a3927 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:27.044997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:27.045709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:27.045990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:27.046264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:27.047083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:27.047387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:27.048789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:27.065271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 633/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 18:56:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:27.070908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:27.163372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7bcf-5a02-4e18-8b65-87f72d3b157f None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:27.194490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:27.195106 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:27.195383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:27.195650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:27.257684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:27.259097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:27.354296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 622/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:56:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:56:27.360483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:27.455100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc4a7f-31f2-4c7b-8f0b-8990aae5e8e3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:27.486601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:27.487376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:27.487650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:27.487918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:27.497179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:27.499235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:27.515502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:27.516537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:27.517525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:27.517525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:27.517525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:27.517525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:27.517525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 634/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:27.522521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:27.613590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1232c9-ba2d-4335-a0a4-f3e540f50e6e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:27.647483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:27.648130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:27.648405 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:27.648674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:27.649373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:27.649700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:27.651040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:27.662045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 623/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:27.667595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:27.760269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eef0e9-ca92-4698-a7a5-1a16cdf4d346 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:27.792301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:27.793064 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:27.793351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:27.793649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:27.800479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:27.801976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:56:27.815106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:27.816171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:27.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 635/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:56:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:27.822029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:27.914173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f2a84-6c1a-4aac-9049-48aac8b67d57 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:27.948870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d052d6d-ae3b-4896-94e4-71e8794827b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:27.949542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052d6d-ae3b-4896-94e4-71e8794827b4 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:27.949820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052d6d-ae3b-4896-94e4-71e8794827b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:27.950089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052d6d-ae3b-4896-94e4-71e8794827b4 None admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:27.950852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d052d6d-ae3b-4896-94e4-71e8794827b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:27.951153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d052d6d-ae3b-4896-94e4-71e8794827b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:27.952580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d052d6d-ae3b-4896-94e4-71e8794827b4 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:27.963865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 624/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:56:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:27.970373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:28.063632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823bc75-5a91-491d-bb07-630bab214df1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:28.095359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15ac21-0103-4415-a0e5-6a5ddb849266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:28.095990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15ac21-0103-4415-a0e5-6a5ddb849266 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:28.096270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15ac21-0103-4415-a0e5-6a5ddb849266 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:28.096544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15ac21-0103-4415-a0e5-6a5ddb849266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:28.097358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15ac21-0103-4415-a0e5-6a5ddb849266 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=4eba1582c17e4df991452d433cbe567b) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:28.097702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15ac21-0103-4415-a0e5-6a5ddb849266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:28.099122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15ac21-0103-4415-a0e5-6a5ddb849266 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:28.104273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 636/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:56:27 2022] GET /identity/v3/role_assignments?user.id=4eba1582c17e4df991452d433cbe567b&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:30.276034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de2d-6ea2-4909-bc02-838398ede90e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:30.276557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de2d-6ea2-4909-bc02-838398ede90e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:30.276557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de2d-6ea2-4909-bc02-838398ede90e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:30.277876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 625/1261] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:30.283580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03165222-243a-468c-a98a-169804cfa174 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:30.283997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03165222-243a-468c-a98a-169804cfa174 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:30.284136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03165222-243a-468c-a98a-169804cfa174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:30.301031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-03165222-243a-468c-a98a-169804cfa174 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:30.302232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-03165222-243a-468c-a98a-169804cfa174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:30.377389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 637/1262] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:56:30.400316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de2d-6ea2-4909-bc02-838398ede90e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:30.502857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de2d-6ea2-4909-bc02-838398ede90e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:30.540157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:30.540859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:30.541135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:30.541400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:30.551199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:56:30.558689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:30.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:30.560742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 626/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:30.566033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03165222-243a-468c-a98a-169804cfa174 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:30.658112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03165222-243a-468c-a98a-169804cfa174 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:30.689356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:30.690034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:30.690312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:30.690584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:30.691320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:30.691622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:30.692982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:30.700532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 638/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:30.706909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:30.798168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48230987-9583-450e-a025-b8647f4a8c7d None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:30.829454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c928c15-d466-4818-8930-805396b8533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:30.830241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c928c15-d466-4818-8930-805396b8533a None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:30.830517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c928c15-d466-4818-8930-805396b8533a None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:30.830785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c928c15-d466-4818-8930-805396b8533a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:30.840513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c928c15-d466-4818-8930-805396b8533a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:30.841968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c928c15-d466-4818-8930-805396b8533a None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-5c928c15-d466-4818-8930-805396b8533a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:30.858139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:30.859179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:30.860441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:30.860441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:30.860441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:30.860441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:30.860441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 627/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:30.864933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:30.960577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378aeca-8ef5-4730-82d4-ddacb45c1dc0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:30.992233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:30.992885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:30.993165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:30.993436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:30.994173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:30.994474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:30.995818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:31.007633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 639/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:56:31.013196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c928c15-d466-4818-8930-805396b8533a None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:31.105932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c928c15-d466-4818-8930-805396b8533a None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:31.136949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:31.137756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:31.138032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:31.138299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:31.145439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:31.146879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:56:31.160347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:31.161413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:31.162742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 628/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:31.167186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:31.259230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f95c9-bf29-4821-809c-ebfb3a33bb9c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:31.290362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:31.291005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:31.291281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:31.291550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:31.292367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:31.292670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:31.294104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:31.310446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 640/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 18:56:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:31.316503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:31.409579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f0b79-1fb7-4789-ab0b-2e092ac275ae None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:31.440332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:31.441092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:31.441364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:31.441662 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:31.451374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:31.452803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:31.469197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:31.470244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:31.471418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:31.471418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:31.471418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:31.471418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:31.471418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 629/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:31.475842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:31.567314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd80d6e-50c8-4622-9d10-d5c8c4af4211 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:31.599150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:31.599797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:31.600075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:31.600346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:31.601241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:31.601573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:31.602922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:31.614573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 641/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:31.620092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:31.711990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa491d-4fd6-46bc-8a19-a0bcde16fe81 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:31.742998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:31.743755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:31.744032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:31.744301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:31.750494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:31.751901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:56:31.765776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:31.766829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:31.768063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 630/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:31.772619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:31.866036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d469d-0f74-462f-aa80-029c4e6b4cde None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:31.901451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23722fc-0402-4979-99eb-3a0a2e02d540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:31.902334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23722fc-0402-4979-99eb-3a0a2e02d540 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:31.902823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23722fc-0402-4979-99eb-3a0a2e02d540 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:31.903317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23722fc-0402-4979-99eb-3a0a2e02d540 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:31.904800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23722fc-0402-4979-99eb-3a0a2e02d540 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:31.905155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23722fc-0402-4979-99eb-3a0a2e02d540 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:31.907404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23722fc-0402-4979-99eb-3a0a2e02d540 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:31.920060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 642/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:31.926714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:32.021265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd8f5a-c257-4c37-89f3-0a36e4b4fe92 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:32.052367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bac9f-eba3-472c-9aee-3628892bebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:32.053232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bac9f-eba3-472c-9aee-3628892bebb0 None admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:32.053633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bac9f-eba3-472c-9aee-3628892bebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:32.053920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bac9f-eba3-472c-9aee-3628892bebb0 None admin] PATH_INFO: `/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/4eba1582c17e4df991452d433cbe567b/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:32.055799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bac9f-eba3-472c-9aee-3628892bebb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3121547cdfa74201b2bd9d6b8a59990e, user_id=4eba1582c17e4df991452d433cbe567b, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:32.057187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bac9f-eba3-472c-9aee-3628892bebb0 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:32.069687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 631/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 18:56:31 2022] PUT /identity/v3/projects/3121547cdfa74201b2bd9d6b8a59990e/users/4eba1582c17e4df991452d433cbe567b/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:56:34.299743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb476c-27b8-4547-99e1-69564dc8c0e1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:34.300249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb476c-27b8-4547-99e1-69564dc8c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:34.300344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb476c-27b8-4547-99e1-69564dc8c0e1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:34.301664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 643/1274] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:34.306837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d84607-7ffa-4a9c-84da-c5dd975570f1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:34.307215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d84607-7ffa-4a9c-84da-c5dd975570f1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:34.307372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d84607-7ffa-4a9c-84da-c5dd975570f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:34.323925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f7d84607-7ffa-4a9c-84da-c5dd975570f1 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:34.325139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f7d84607-7ffa-4a9c-84da-c5dd975570f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:34.395681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 632/1275] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:56:34.419431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb476c-27b8-4547-99e1-69564dc8c0e1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:34.511621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb476c-27b8-4547-99e1-69564dc8c0e1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:34.542884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:34.543647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:34.543921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:34.544189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:34.553532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:56:34.561339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:34.562442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:34.563424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 644/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 18:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:34.568264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d84607-7ffa-4a9c-84da-c5dd975570f1 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:34.659780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d84607-7ffa-4a9c-84da-c5dd975570f1 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:34.690997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:34.691643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:34.691921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:34.692191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:34.692919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:34.693222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:34.694596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:34.703254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 633/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 18:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:34.708899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:34.801925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1f3fa-11f8-4dc0-980f-92312882fe8a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:34.832863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:34.833598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:34.833878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:34.834147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:34.844056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:34.845492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:34.862116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:34.863131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:34.864385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:34.864385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:34.864385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:34.864385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:34.864385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 645/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:34.868666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:34.962985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132ec8f-ecea-44e9-b8bf-5e9658464911 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:34.994461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:34.995112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:34.995389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:34.995660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:34.996370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:34.996674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:34.998057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:35.009557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 634/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:35.015122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:35.107069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252139a2-ec29-4673-8a3b-a6a8f4b9bfb2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:35.138156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:35.138932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:35.139208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:35.139478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:35.146794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:35.148209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:56:35.162325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:35.163434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:35.164602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 646/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:35.169140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:35.261856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df76ab2-6534-4ccc-bdbe-bf5c77eb146e None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:35.293563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:35.294055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:35.294337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:35.294609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:35.296036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:35.296340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:35.297780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:35.313611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 635/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 18:56:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:35.319401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:35.423290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198045c-2599-47ca-baad-ee45c9071746 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:35.453804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:35.454431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:35.454704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:35.454973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:35.517426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:35.518910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:35.608087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 647/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 18:56:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:56:35.613838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:35.704921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa3ec-aa10-4fdc-8023-0914651ed605 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:35.735900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:35.736694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:35.736969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:35.737235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:35.746724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:35.748166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:56:35.765059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:35.766198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:35.767294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:56:35.767294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:56:35.767294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:56:35.767294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:35.767294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 636/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 18:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:35.772085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:35.864070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd42e0-1964-4c1a-accf-e1c4789f2a42 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:35.896239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:35.896881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:35.897156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:35.897426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:35.898156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:35.898458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:35.899793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:35.910333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 648/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 18:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:35.915692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:36.009574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cd1dd-0d1b-457e-a81b-92ae6326dfd9 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:36.041345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:36.042148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:36.042429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:36.042704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:36.048988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:36.050453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:56:36.064321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application with Lock( May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:36.065334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: ERROR keystone.server.flask.application May 04 18:56:36.066476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 637/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 18:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:36.071169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:36.163913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d0bf-024b-4d82-b47b-545a4bba9831 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:36.194863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fafa3d-d347-419d-85a5-6c633e1ed7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:36.195495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fafa3d-d347-419d-85a5-6c633e1ed7ba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:36.195774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fafa3d-d347-419d-85a5-6c633e1ed7ba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:36.196039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fafa3d-d347-419d-85a5-6c633e1ed7ba None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:36.196801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fafa3d-d347-419d-85a5-6c633e1ed7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:36.197102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fafa3d-d347-419d-85a5-6c633e1ed7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:36.198517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fafa3d-d347-419d-85a5-6c633e1ed7ba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:36.210289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 649/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 18:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:36.216072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:36.309715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f593b-b469-4025-86d4-b33a6a9a6715 None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:36.344241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785fbb-6b24-4fc7-9204-91c3de7e77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:36.344892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785fbb-6b24-4fc7-9204-91c3de7e77d8 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:36.345271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785fbb-6b24-4fc7-9204-91c3de7e77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:36.345454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785fbb-6b24-4fc7-9204-91c3de7e77d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:36.346276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1785fbb-6b24-4fc7-9204-91c3de7e77d8 None admin] RBAC: Adding query filter params (role.id=5df21f78b56544bab70a97ed6d984d60, scope.project.id=3121547cdfa74201b2bd9d6b8a59990e, user.id=4eba1582c17e4df991452d433cbe567b) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:36.346622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1785fbb-6b24-4fc7-9204-91c3de7e77d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:36.347998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1785fbb-6b24-4fc7-9204-91c3de7e77d8 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:36.353833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 638/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 18:56:36 2022] GET /identity/v3/role_assignments?user.id=4eba1582c17e4df991452d433cbe567b&scope.project.id=3121547cdfa74201b2bd9d6b8a59990e&role.id=5df21f78b56544bab70a97ed6d984d60 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:38.559718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c75ed-e91b-4ede-945f-aaadee8e167e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:38.560266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c75ed-e91b-4ede-945f-aaadee8e167e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:38.560266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c75ed-e91b-4ede-945f-aaadee8e167e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:38.561656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 650/1288] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:38.566631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfee7da-d822-4020-b18e-9c7c0dd3ad79 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:38.567010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfee7da-d822-4020-b18e-9c7c0dd3ad79 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:38.567187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfee7da-d822-4020-b18e-9c7c0dd3ad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:38.583751 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-bcfee7da-d822-4020-b18e-9c7c0dd3ad79 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:38.584919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bcfee7da-d822-4020-b18e-9c7c0dd3ad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:38.646951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 639/1289] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:56:38.668411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c75ed-e91b-4ede-945f-aaadee8e167e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:38.761504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c75ed-e91b-4ede-945f-aaadee8e167e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:38.793593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:38.794368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:38.794646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:38.794942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:38.795576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:38.796916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:38.808227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:38.809413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:38.810519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 651/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:56:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:38.815592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfee7da-d822-4020-b18e-9c7c0dd3ad79 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:38.913216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfee7da-d822-4020-b18e-9c7c0dd3ad79 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:38.944683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2aab3-a5ab-4de5-89cb-cc137a975048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:38.945327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2aab3-a5ab-4de5-89cb-cc137a975048 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:38.945638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2aab3-a5ab-4de5-89cb-cc137a975048 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:38.945914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2aab3-a5ab-4de5-89cb-cc137a975048 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:38.946604 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2aab3-a5ab-4de5-89cb-cc137a975048 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:38.946907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2aab3-a5ab-4de5-89cb-cc137a975048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:38.948253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2aab3-a5ab-4de5-89cb-cc137a975048 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:38.953438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 640/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 18:56:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:38.959066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:39.052451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ee3e-50c5-4a36-88c7-d6d998097d44 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:39.084162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd30e-7c1d-4dca-b985-720b4516374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:39.084745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd30e-7c1d-4dca-b985-720b4516374a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:39.085023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd30e-7c1d-4dca-b985-720b4516374a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:39.085291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd30e-7c1d-4dca-b985-720b4516374a None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:39.086007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd30e-7c1d-4dca-b985-720b4516374a None admin] RBAC: Adding query filter params (type=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:39.086307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd30e-7c1d-4dca-b985-720b4516374a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:39.087657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd30e-7c1d-4dca-b985-720b4516374a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:39.091845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 652/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 18:56:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:41.319835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcbe40-38be-4203-917a-f71c31c506cd None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:41.320425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcbe40-38be-4203-917a-f71c31c506cd None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:41.320574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcbe40-38be-4203-917a-f71c31c506cd None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:41.322046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 641/1293] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:41.328321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c639db-3fba-4c8f-8914-7ea017905007 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:41.328758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c639db-3fba-4c8f-8914-7ea017905007 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:41.328905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c639db-3fba-4c8f-8914-7ea017905007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:41.346160 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-18c639db-3fba-4c8f-8914-7ea017905007 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:41.347333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-18c639db-3fba-4c8f-8914-7ea017905007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:41.413405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 653/1294] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:56:41.436336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcbe40-38be-4203-917a-f71c31c506cd None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:41.531339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcbe40-38be-4203-917a-f71c31c506cd None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:41.563657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5239ea-70cf-4545-a6b9-2bf0c77168cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:41.564299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5239ea-70cf-4545-a6b9-2bf0c77168cf None admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:41.564579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5239ea-70cf-4545-a6b9-2bf0c77168cf None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:41.564853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5239ea-70cf-4545-a6b9-2bf0c77168cf None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:41.565578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5239ea-70cf-4545-a6b9-2bf0c77168cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:41.566927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5239ea-70cf-4545-a6b9-2bf0c77168cf None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:41.579144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 642/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 18:56:41 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:43.778503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f25014-9b10-4a95-b3eb-1014ac111111 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:43.779107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f25014-9b10-4a95-b3eb-1014ac111111 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:43.781153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f25014-9b10-4a95-b3eb-1014ac111111 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:43.782571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 654/1296] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:43.787922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df221-742c-429b-80a3-2425dca6ccfc None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:43.788308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df221-742c-429b-80a3-2425dca6ccfc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:43.788472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df221-742c-429b-80a3-2425dca6ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:43.804658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b15df221-742c-429b-80a3-2425dca6ccfc None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:43.805856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b15df221-742c-429b-80a3-2425dca6ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:43.872747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 643/1297] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:56:43.895509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f25014-9b10-4a95-b3eb-1014ac111111 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:43.996128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f25014-9b10-4a95-b3eb-1014ac111111 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:44.027726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:44.028600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:44.028832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:44.029764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:44.030409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:44.031757 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:44.043104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:44.044245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:44.045523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 655/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:56:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:44.050312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df221-742c-429b-80a3-2425dca6ccfc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:44.144074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df221-742c-429b-80a3-2425dca6ccfc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:44.174749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:44.175394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:44.175668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:44.175938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:44.176623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] RBAC: Adding query filter params (name=placement) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:44.176923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:44.178317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:44.183140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 644/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 18:56:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:44.189544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:44.282734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d6875-185e-41f1-a90d-1250a8f59d6e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:44.313859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e07814-9d2a-4023-9099-9505ccce5b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:44.314497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e07814-9d2a-4023-9099-9505ccce5b6a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:44.314774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e07814-9d2a-4023-9099-9505ccce5b6a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:44.315044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e07814-9d2a-4023-9099-9505ccce5b6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:44.315814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e07814-9d2a-4023-9099-9505ccce5b6a None admin] RBAC: Adding query filter params (interface=public, service_id=cf3a4c4f7ef3443fb85a3881cea34087, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:44.316118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e07814-9d2a-4023-9099-9505ccce5b6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:44.317456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e07814-9d2a-4023-9099-9505ccce5b6a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:44.322591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 656/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 18:56:44 2022] GET /identity/v3/endpoints?service_id=cf3a4c4f7ef3443fb85a3881cea34087&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:44.328877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:44.428710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a59b6-b502-41d6-8ac9-f509c6b7808b None admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:44.460756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4d45e-6b5b-4e15-9727-a49137e28cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:44.461408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d45e-6b5b-4e15-9727-a49137e28cdf None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:44.461717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d45e-6b5b-4e15-9727-a49137e28cdf None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:44.461990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d45e-6b5b-4e15-9727-a49137e28cdf None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:44.462661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4d45e-6b5b-4e15-9727-a49137e28cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:44.464003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4d45e-6b5b-4e15-9727-a49137e28cdf None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:44.470540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 645/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 18:56:44 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:46.743924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83c27-09f5-4f29-8e21-988d2c28f719 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:46.744450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83c27-09f5-4f29-8e21-988d2c28f719 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:46.744450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83c27-09f5-4f29-8e21-988d2c28f719 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:46.745864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 657/1302] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:46.750954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c75eda-bd5a-46be-b629-7d51f4c83851 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:46.751372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c75eda-bd5a-46be-b629-7d51f4c83851 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:46.751520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c75eda-bd5a-46be-b629-7d51f4c83851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:46.768041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b3c75eda-bd5a-46be-b629-7d51f4c83851 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:46.769206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b3c75eda-bd5a-46be-b629-7d51f4c83851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:46.831652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 646/1303] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:56:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:56:46.854256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83c27-09f5-4f29-8e21-988d2c28f719 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:46.948005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83c27-09f5-4f29-8e21-988d2c28f719 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:46.979547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:46.980325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:46.980597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:46.980864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:46.981523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:46.982859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:56:46.994175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:56:46.995286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 04 18:56:46.996461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 658/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 18:56:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:56:47.001214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c75eda-bd5a-46be-b629-7d51f4c83851 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:47.093411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c75eda-bd5a-46be-b629-7d51f4c83851 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:47.125232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e97382-855d-45dd-8469-26b9e42d80b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:47.125909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97382-855d-45dd-8469-26b9e42d80b8 None admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:47.126192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97382-855d-45dd-8469-26b9e42d80b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:47.126467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97382-855d-45dd-8469-26b9e42d80b8 None admin] PATH_INFO: `/v3/services` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:47.127161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e97382-855d-45dd-8469-26b9e42d80b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:47.127466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e97382-855d-45dd-8469-26b9e42d80b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:47.128818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e97382-855d-45dd-8469-26b9e42d80b8 None admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:47.133790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 647/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 18:56:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:47.139994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:47.232684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beca5f2-8614-43d7-8ed3-42b9c5b36d02 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:47.264105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30f270-052c-4d6d-9e83-0c01ccbbf66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:47.264683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30f270-052c-4d6d-9e83-0c01ccbbf66a None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:47.264961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30f270-052c-4d6d-9e83-0c01ccbbf66a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:47.265234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30f270-052c-4d6d-9e83-0c01ccbbf66a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:47.265996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30f270-052c-4d6d-9e83-0c01ccbbf66a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:47.267337 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30f270-052c-4d6d-9e83-0c01ccbbf66a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:47.284547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 659/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 18:56:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:50.635703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee87e4-37d1-4d7c-8d29-2371e9f012b0 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:50.636735 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee87e4-37d1-4d7c-8d29-2371e9f012b0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:50.637232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee87e4-37d1-4d7c-8d29-2371e9f012b0 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:50.645136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6edd9-a75c-4eaa-a400-a2bd52136b30 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:50.645994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6edd9-a75c-4eaa-a400-a2bd52136b30 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:50.646487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6edd9-a75c-4eaa-a400-a2bd52136b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:50.648843 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 648/1307] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:57:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:50.839460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-27c6edd9-a75c-4eaa-a400-a2bd52136b30 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:50.843171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-27c6edd9-a75c-4eaa-a400-a2bd52136b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:50.997499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 660/1308] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:51.046693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67d5d-7190-4528-9d4b-df8e82f0bcfc None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:51.046996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67d5d-7190-4528-9d4b-df8e82f0bcfc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:51.047556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67d5d-7190-4528-9d4b-df8e82f0bcfc None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:51.048971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 649/1309] 10.222.0.69 () {54 vars in 964 bytes} [Wed May 4 18:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:51.055973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791320-8a4a-4482-8253-76f424e48b23 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:51.057037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791320-8a4a-4482-8253-76f424e48b23 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:51.057431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791320-8a4a-4482-8253-76f424e48b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:51.132020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4a791320-8a4a-4482-8253-76f424e48b23 None None] MFA Rules not processed for user `39f773f90b8c47608040ee24866242f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:51.133398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4a791320-8a4a-4482-8253-76f424e48b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:51.209565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 661/1310] 10.222.0.69 () {58 vars in 1061 bytes} [Wed May 4 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:51.219778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f67d5d-7190-4528-9d4b-df8e82f0bcfc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:51.221878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-93f67d5d-7190-4528-9d4b-df8e82f0bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:51.326950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f67d5d-7190-4528-9d4b-df8e82f0bcfc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:51.404658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece04d2e-9dd0-4eb6-8d34-63ae23f9361d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:51.405629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece04d2e-9dd0-4eb6-8d34-63ae23f9361d service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:51.406099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece04d2e-9dd0-4eb6-8d34-63ae23f9361d service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:51.406526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece04d2e-9dd0-4eb6-8d34-63ae23f9361d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:51.408387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ece04d2e-9dd0-4eb6-8d34-63ae23f9361d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:51.512384 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece04d2e-9dd0-4eb6-8d34-63ae23f9361d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:51.513836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece04d2e-9dd0-4eb6-8d34-63ae23f9361d service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:51.532411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 650/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:54.102420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248aea-56fe-4427-9340-ea5eb6ce9130 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.102967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248aea-56fe-4427-9340-ea5eb6ce9130 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.103262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248aea-56fe-4427-9340-ea5eb6ce9130 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.105439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 662/1312] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:54.111286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd85e-20d0-48d5-aa72-8fc796c4ed88 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.111839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd85e-20d0-48d5-aa72-8fc796c4ed88 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.111839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd85e-20d0-48d5-aa72-8fc796c4ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.190626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b0fbd85e-20d0-48d5-aa72-8fc796c4ed88 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:54.192133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b0fbd85e-20d0-48d5-aa72-8fc796c4ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:54.297326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 651/1313] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:54.336962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248aea-56fe-4427-9340-ea5eb6ce9130 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.338696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2a248aea-56fe-4427-9340-ea5eb6ce9130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:54.441521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248aea-56fe-4427-9340-ea5eb6ce9130 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.515883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d5406-a650-48c7-9a96-9fc5a39b2f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.516534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d5406-a650-48c7-9a96-9fc5a39b2f2b service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.516817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d5406-a650-48c7-9a96-9fc5a39b2f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.517201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d5406-a650-48c7-9a96-9fc5a39b2f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.518894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-295d5406-a650-48c7-9a96-9fc5a39b2f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:54.628727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d5406-a650-48c7-9a96-9fc5a39b2f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.630121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d5406-a650-48c7-9a96-9fc5a39b2f2b service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.649285 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 663/1314] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:57.206227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc796-5e1d-4f4b-a2b7-b38f23318a2b None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:57.206818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc796-5e1d-4f4b-a2b7-b38f23318a2b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:57.206818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc796-5e1d-4f4b-a2b7-b38f23318a2b None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:57.208142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 652/1315] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:57.213299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a97e5-55ab-49f8-a297-19adb68eede9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:57.214238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a97e5-55ab-49f8-a297-19adb68eede9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:57.214382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a97e5-55ab-49f8-a297-19adb68eede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:57.276017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2d2a97e5-55ab-49f8-a297-19adb68eede9 None None] MFA Rules not processed for user `c8a713a9aefa4037914c8eafea80ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:57.277699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2d2a97e5-55ab-49f8-a297-19adb68eede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:57.368177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 664/1316] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:57:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:57.408073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc796-5e1d-4f4b-a2b7-b38f23318a2b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:57.409629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ef2dc796-5e1d-4f4b-a2b7-b38f23318a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:57.511404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc796-5e1d-4f4b-a2b7-b38f23318a2b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:57.581680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab17f49-0ae2-4610-8900-70092f49ba14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:57.582319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab17f49-0ae2-4610-8900-70092f49ba14 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:57.582602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab17f49-0ae2-4610-8900-70092f49ba14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:57.582872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab17f49-0ae2-4610-8900-70092f49ba14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:57.584501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1ab17f49-0ae2-4610-8900-70092f49ba14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:57.687695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab17f49-0ae2-4610-8900-70092f49ba14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:57.689110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab17f49-0ae2-4610-8900-70092f49ba14 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:57.706508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 653/1317] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:57:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:00.430219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa644-ecb6-4046-a972-922b166f1ab5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.430752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa644-ecb6-4046-a972-922b166f1ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.430752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa644-ecb6-4046-a972-922b166f1ab5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.432854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 665/1318] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:00.438108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54f88-dae8-4c59-a357-0758ca10827e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.438511 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54f88-dae8-4c59-a357-0758ca10827e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.438660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54f88-dae8-4c59-a357-0758ca10827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.499699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-22a54f88-dae8-4c59-a357-0758ca10827e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:00.500898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-22a54f88-dae8-4c59-a357-0758ca10827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.591651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 654/1319] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:00.649872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58e247-3faf-4ee9-90d2-a57d6ea23c7e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.650155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58e247-3faf-4ee9-90d2-a57d6ea23c7e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.650428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58e247-3faf-4ee9-90d2-a57d6ea23c7e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.652304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 666/1320] 10.222.0.69 () {54 vars in 964 bytes} [Wed May 4 18:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:00.658377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea346f-f94a-4789-8f5e-560536ba69b9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.658664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea346f-f94a-4789-8f5e-560536ba69b9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.658940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea346f-f94a-4789-8f5e-560536ba69b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.730569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9dea346f-f94a-4789-8f5e-560536ba69b9 None None] MFA Rules not processed for user `39f773f90b8c47608040ee24866242f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:00.731695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9dea346f-f94a-4789-8f5e-560536ba69b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.803120 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 655/1321] 10.222.0.69 () {58 vars in 1061 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:00.812185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58e247-3faf-4ee9-90d2-a57d6ea23c7e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.813715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5b58e247-3faf-4ee9-90d2-a57d6ea23c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.911185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58e247-3faf-4ee9-90d2-a57d6ea23c7e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.986159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13588ef6-4b8e-4fa6-b3f7-c70fe7c3adba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.986745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588ef6-4b8e-4fa6-b3f7-c70fe7c3adba service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.987022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588ef6-4b8e-4fa6-b3f7-c70fe7c3adba service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.987292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588ef6-4b8e-4fa6-b3f7-c70fe7c3adba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.988920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-13588ef6-4b8e-4fa6-b3f7-c70fe7c3adba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:01.094977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13588ef6-4b8e-4fa6-b3f7-c70fe7c3adba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.096389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13588ef6-4b8e-4fa6-b3f7-c70fe7c3adba service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.113196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 667/1322] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:04.454382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1d67d-64cb-4bfd-8c7c-61918af8e49a None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:04.454948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1d67d-64cb-4bfd-8c7c-61918af8e49a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:04.454948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1d67d-64cb-4bfd-8c7c-61918af8e49a None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:04.456314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 656/1323] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:04.461671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f0f8-c0be-4163-aa1d-9a48fc4c6e4c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:04.462077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f0f8-c0be-4163-aa1d-9a48fc4c6e4c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:04.462357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f0f8-c0be-4163-aa1d-9a48fc4c6e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:04.524568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9703f0f8-c0be-4163-aa1d-9a48fc4c6e4c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:04.525796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9703f0f8-c0be-4163-aa1d-9a48fc4c6e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:04.627249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 668/1324] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:04.663666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1d67d-64cb-4bfd-8c7c-61918af8e49a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:04.665216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-15c1d67d-64cb-4bfd-8c7c-61918af8e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:04.766201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1d67d-64cb-4bfd-8c7c-61918af8e49a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:04.836878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1feec-03f4-41d3-8c2e-e95e1d59a787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:04.837558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1feec-03f4-41d3-8c2e-e95e1d59a787 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:04.837841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1feec-03f4-41d3-8c2e-e95e1d59a787 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:04.838173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1feec-03f4-41d3-8c2e-e95e1d59a787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:04.839856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-09f1feec-03f4-41d3-8c2e-e95e1d59a787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:04.952529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1feec-03f4-41d3-8c2e-e95e1d59a787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:04.954012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1feec-03f4-41d3-8c2e-e95e1d59a787 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:04.973827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 657/1325] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:07.289851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fb4df-6d43-46d5-bccd-631975ba737b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:07.290361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fb4df-6d43-46d5-bccd-631975ba737b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:07.290361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fb4df-6d43-46d5-bccd-631975ba737b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:07.291745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 669/1326] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:07.297005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ae2e8-8fb6-481c-a434-26e1b7d0f460 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:07.297443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ae2e8-8fb6-481c-a434-26e1b7d0f460 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:07.297625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ae2e8-8fb6-481c-a434-26e1b7d0f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:07.359901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c33ae2e8-8fb6-481c-a434-26e1b7d0f460 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:07.361110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c33ae2e8-8fb6-481c-a434-26e1b7d0f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:07.455479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 658/1327] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:07.492722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fb4df-6d43-46d5-bccd-631975ba737b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:07.494281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c28fb4df-6d43-46d5-bccd-631975ba737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:07.595214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fb4df-6d43-46d5-bccd-631975ba737b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:07.664791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99c5b-6433-427d-bd05-c40e7c185ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:07.665425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99c5b-6433-427d-bd05-c40e7c185ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:07.665741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99c5b-6433-427d-bd05-c40e7c185ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:07.666013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99c5b-6433-427d-bd05-c40e7c185ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:07.667654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-63a99c5b-6433-427d-bd05-c40e7c185ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:07.772138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99c5b-6433-427d-bd05-c40e7c185ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:07.773614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99c5b-6433-427d-bd05-c40e7c185ab3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:07.790759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 670/1328] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:10.070874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b5f1-4d33-476b-8fd0-181f5ac533d4 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.071415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b5f1-4d33-476b-8fd0-181f5ac533d4 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.071415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b5f1-4d33-476b-8fd0-181f5ac533d4 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.073293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 659/1329] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:10.078780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb8aba-b6cd-4d0f-9da1-902b22e2d3c8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.079191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb8aba-b6cd-4d0f-9da1-902b22e2d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.079371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb8aba-b6cd-4d0f-9da1-902b22e2d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.142296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1ddb8aba-b6cd-4d0f-9da1-902b22e2d3c8 None None] MFA Rules not processed for user `c8a713a9aefa4037914c8eafea80ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:10.143502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1ddb8aba-b6cd-4d0f-9da1-902b22e2d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:10.237758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 671/1330] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:10.274441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b5f1-4d33-476b-8fd0-181f5ac533d4 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:10.276566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b368b5f1-4d33-476b-8fd0-181f5ac533d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:10.376901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b5f1-4d33-476b-8fd0-181f5ac533d4 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:10.446396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5f91a-d836-47a0-b7e4-56be167d7607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:10.447046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f91a-d836-47a0-b7e4-56be167d7607 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.447342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f91a-d836-47a0-b7e4-56be167d7607 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.448134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f91a-d836-47a0-b7e4-56be167d7607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.449781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2ad5f91a-d836-47a0-b7e4-56be167d7607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:10.552479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5f91a-d836-47a0-b7e4-56be167d7607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:10.553968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5f91a-d836-47a0-b7e4-56be167d7607 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.572162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 660/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:13.060357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdbef1-db6c-4e02-89c2-1ba1d576cc9f None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:13.060888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdbef1-db6c-4e02-89c2-1ba1d576cc9f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:13.060888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdbef1-db6c-4e02-89c2-1ba1d576cc9f None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:13.062291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 672/1332] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:13.067388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f68ca-2d55-419b-9f06-d1adcf1e9e23 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:13.067792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f68ca-2d55-419b-9f06-d1adcf1e9e23 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:13.067945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f68ca-2d55-419b-9f06-d1adcf1e9e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:13.130189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-501f68ca-2d55-419b-9f06-d1adcf1e9e23 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:13.131312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-501f68ca-2d55-419b-9f06-d1adcf1e9e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:13.224800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 661/1333] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:13.260988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdbef1-db6c-4e02-89c2-1ba1d576cc9f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:13.262569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8fbdbef1-db6c-4e02-89c2-1ba1d576cc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:13.365098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdbef1-db6c-4e02-89c2-1ba1d576cc9f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:13.435835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094b7d3-0849-4ad1-8fa1-7af8dab02bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:13.436479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094b7d3-0849-4ad1-8fa1-7af8dab02bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:13.436759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094b7d3-0849-4ad1-8fa1-7af8dab02bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:13.437032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094b7d3-0849-4ad1-8fa1-7af8dab02bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:13.438690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0094b7d3-0849-4ad1-8fa1-7af8dab02bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:13.545494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094b7d3-0849-4ad1-8fa1-7af8dab02bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:13.546941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094b7d3-0849-4ad1-8fa1-7af8dab02bc5 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:13.565015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 673/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:15.844714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42bbb7-c260-4cca-a970-0c81f7ccc557 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:15.845246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42bbb7-c260-4cca-a970-0c81f7ccc557 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:15.845246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42bbb7-c260-4cca-a970-0c81f7ccc557 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:15.846669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 662/1335] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:15.851846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88eee-b3a0-4d14-9dbb-d17072d6d81b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:15.852257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88eee-b3a0-4d14-9dbb-d17072d6d81b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:15.852404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88eee-b3a0-4d14-9dbb-d17072d6d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:15.916802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2de88eee-b3a0-4d14-9dbb-d17072d6d81b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:15.918024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2de88eee-b3a0-4d14-9dbb-d17072d6d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:16.013986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 674/1336] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:16.053163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42bbb7-c260-4cca-a970-0c81f7ccc557 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:16.054742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4c42bbb7-c260-4cca-a970-0c81f7ccc557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:16.151649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42bbb7-c260-4cca-a970-0c81f7ccc557 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:16.220500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb01feb-c0bf-4665-bd08-e0f11a15a084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:16.221134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01feb-c0bf-4665-bd08-e0f11a15a084 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.221412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01feb-c0bf-4665-bd08-e0f11a15a084 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.221714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01feb-c0bf-4665-bd08-e0f11a15a084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.223311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6eb01feb-c0bf-4665-bd08-e0f11a15a084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:16.328462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb01feb-c0bf-4665-bd08-e0f11a15a084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:16.329947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb01feb-c0bf-4665-bd08-e0f11a15a084 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:16.347692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 663/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:18.951196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba321-d86c-4e86-93eb-e4e406375c33 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:18.951729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba321-d86c-4e86-93eb-e4e406375c33 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:18.951729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba321-d86c-4e86-93eb-e4e406375c33 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:18.953096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 675/1338] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:18.958264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903b92b-9987-4af1-8abd-49108b44bc46 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:18.958711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903b92b-9987-4af1-8abd-49108b44bc46 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:18.958888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903b92b-9987-4af1-8abd-49108b44bc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:19.021835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a903b92b-9987-4af1-8abd-49108b44bc46 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:19.023013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a903b92b-9987-4af1-8abd-49108b44bc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:19.112566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 664/1339] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:19.147714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba321-d86c-4e86-93eb-e4e406375c33 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:19.149234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-845ba321-d86c-4e86-93eb-e4e406375c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:19.250657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba321-d86c-4e86-93eb-e4e406375c33 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:19.320881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa7183-8fc3-4ea7-8f16-ac1d58efd560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:19.321548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa7183-8fc3-4ea7-8f16-ac1d58efd560 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:19.321831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa7183-8fc3-4ea7-8f16-ac1d58efd560 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:19.322142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa7183-8fc3-4ea7-8f16-ac1d58efd560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:19.323759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9daa7183-8fc3-4ea7-8f16-ac1d58efd560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:19.427666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa7183-8fc3-4ea7-8f16-ac1d58efd560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:19.429097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa7183-8fc3-4ea7-8f16-ac1d58efd560 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:19.446281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 676/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:23.633185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260586-47df-4c23-ae08-05731081a7a0 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.633737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260586-47df-4c23-ae08-05731081a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.633737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260586-47df-4c23-ae08-05731081a7a0 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.635606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 665/1341] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:23.640728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afb9c1-22c6-4dbe-b721-366a0b07640a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.641143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afb9c1-22c6-4dbe-b721-366a0b07640a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.641426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afb9c1-22c6-4dbe-b721-366a0b07640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.709848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-37afb9c1-22c6-4dbe-b721-366a0b07640a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:23.711032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-37afb9c1-22c6-4dbe-b721-366a0b07640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:23.810612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 677/1342] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:23.849399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a260586-47df-4c23-ae08-05731081a7a0 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.851511 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4a260586-47df-4c23-ae08-05731081a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:23.948992 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a260586-47df-4c23-ae08-05731081a7a0 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.952690 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975958c-c383-405d-9cc8-cdb027945b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.953336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975958c-c383-405d-9cc8-cdb027945b1e service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.953674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975958c-c383-405d-9cc8-cdb027945b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.953956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975958c-c383-405d-9cc8-cdb027945b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.963377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975958c-c383-405d-9cc8-cdb027945b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.964823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975958c-c383-405d-9cc8-cdb027945b1e service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.974595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 666/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:26.837399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c8f74-80cc-45eb-9f15-8efb3dcaca71 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:26.837961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c8f74-80cc-45eb-9f15-8efb3dcaca71 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:26.837961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c8f74-80cc-45eb-9f15-8efb3dcaca71 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:26.839344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 678/1344] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:26.844621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579275d4-9d00-4526-860d-49d4f6ef0a2f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:26.845035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579275d4-9d00-4526-860d-49d4f6ef0a2f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:26.845190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579275d4-9d00-4526-860d-49d4f6ef0a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:26.872707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-579275d4-9d00-4526-860d-49d4f6ef0a2f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:26.873899 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-579275d4-9d00-4526-860d-49d4f6ef0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:26.946919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 667/1345] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:26.984354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c8f74-80cc-45eb-9f15-8efb3dcaca71 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:26.995001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c8f74-80cc-45eb-9f15-8efb3dcaca71 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:26.998471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7de1d-bf75-4d54-96a4-4887c860381c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:26.999157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7de1d-bf75-4d54-96a4-4887c860381c service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:26.999435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7de1d-bf75-4d54-96a4-4887c860381c service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:26.999704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7de1d-bf75-4d54-96a4-4887c860381c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:27.008515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7de1d-bf75-4d54-96a4-4887c860381c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:27.009966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7de1d-bf75-4d54-96a4-4887c860381c service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:27.019519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 679/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:31.240983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a826e-7181-4943-95f2-a588d92a38bd None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:31.241548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a826e-7181-4943-95f2-a588d92a38bd None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:31.241548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a826e-7181-4943-95f2-a588d92a38bd None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:31.242865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 668/1347] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:31.248020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fe09c-f4cb-427f-9ddf-e4c43fd6867b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:31.248453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fe09c-f4cb-427f-9ddf-e4c43fd6867b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:31.248582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fe09c-f4cb-427f-9ddf-e4c43fd6867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:31.266955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ac5fe09c-f4cb-427f-9ddf-e4c43fd6867b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:31.268229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ac5fe09c-f4cb-427f-9ddf-e4c43fd6867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:31.276960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 680/1348] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:31.319099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a826e-7181-4943-95f2-a588d92a38bd None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:31.330207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a826e-7181-4943-95f2-a588d92a38bd None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:31.333976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61fcbf-4313-4467-bf54-3264be04883e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:31.334645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61fcbf-4313-4467-bf54-3264be04883e service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:31.334960 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61fcbf-4313-4467-bf54-3264be04883e service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:31.335357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61fcbf-4313-4467-bf54-3264be04883e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:31.346487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61fcbf-4313-4467-bf54-3264be04883e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:31.347944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61fcbf-4313-4467-bf54-3264be04883e service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:31.358263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 669/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:36.701144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a540-1ccc-4bab-a6f4-03aac4b4fc09 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:36.701677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a540-1ccc-4bab-a6f4-03aac4b4fc09 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:36.701768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a540-1ccc-4bab-a6f4-03aac4b4fc09 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:36.703345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 681/1350] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 18:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:36.708647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd6a7-c8ec-4ec5-ac36-441174e63ce1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:36.709063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd6a7-c8ec-4ec5-ac36-441174e63ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:36.709144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd6a7-c8ec-4ec5-ac36-441174e63ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:36.789896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8ddfd6a7-c8ec-4ec5-ac36-441174e63ce1 None None] MFA Rules not processed for user `4eba1582c17e4df991452d433cbe567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:36.791990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8ddfd6a7-c8ec-4ec5-ac36-441174e63ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:36.884904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 670/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:41.237321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5d1ca-3820-48aa-b251-60b7fd4fbb51 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.238206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5d1ca-3820-48aa-b251-60b7fd4fbb51 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.238657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5d1ca-3820-48aa-b251-60b7fd4fbb51 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.240046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 682/1352] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 18:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:41.245234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7059-51ce-42d4-ba2a-e0111b37d928 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.246105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7059-51ce-42d4-ba2a-e0111b37d928 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.246642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7059-51ce-42d4-ba2a-e0111b37d928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.264766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-67de7059-51ce-42d4-ba2a-e0111b37d928 None None] MFA Rules not processed for user `4eba1582c17e4df991452d433cbe567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:41.265981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-67de7059-51ce-42d4-ba2a-e0111b37d928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.275337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 671/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:42.802082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53511c-8875-4532-8ffe-83724e58f455 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.802626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53511c-8875-4532-8ffe-83724e58f455 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.802757 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53511c-8875-4532-8ffe-83724e58f455 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.804145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 683/1354] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 18:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:42.809059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20575a4-cf74-4259-88d3-b83b45f0c040 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.809511 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20575a4-cf74-4259-88d3-b83b45f0c040 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.809641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20575a4-cf74-4259-88d3-b83b45f0c040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.826939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a20575a4-cf74-4259-88d3-b83b45f0c040 None None] MFA Rules not processed for user `4eba1582c17e4df991452d433cbe567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:42.828105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a20575a4-cf74-4259-88d3-b83b45f0c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:42.836373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 672/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:46.709812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a653c-bbf7-4d26-8f5c-951aef5d9370 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:46.710374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a653c-bbf7-4d26-8f5c-951aef5d9370 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:46.710374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a653c-bbf7-4d26-8f5c-951aef5d9370 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:46.712280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 684/1356] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:46.717199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9055-5f7a-43d1-ab8e-9c06aed2d457 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:46.717666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9055-5f7a-43d1-ab8e-9c06aed2d457 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:46.717774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9055-5f7a-43d1-ab8e-9c06aed2d457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:46.736191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-907e9055-5f7a-43d1-ab8e-9c06aed2d457 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:46.737623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-907e9055-5f7a-43d1-ab8e-9c06aed2d457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:46.746245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 673/1357] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:46.797215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff371-1db1-4608-98ef-8e2baee94a0a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:46.797526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff371-1db1-4608-98ef-8e2baee94a0a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:46.798001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff371-1db1-4608-98ef-8e2baee94a0a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:46.799493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 685/1358] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 18:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:46.804491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc99ae-56fa-4c3c-9c82-64977458433a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:46.804776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc99ae-56fa-4c3c-9c82-64977458433a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:46.805048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc99ae-56fa-4c3c-9c82-64977458433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:46.854645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e0dc99ae-56fa-4c3c-9c82-64977458433a None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:46.856171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e0dc99ae-56fa-4c3c-9c82-64977458433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:46.941985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 674/1359] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 18:58:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:46.950690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ff371-1db1-4608-98ef-8e2baee94a0a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:46.966112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ff371-1db1-4608-98ef-8e2baee94a0a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:46.972021 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a29cb-eafb-44d0-b4a5-f20997bdbd89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:46.973254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a29cb-eafb-44d0-b4a5-f20997bdbd89 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:46.973580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a29cb-eafb-44d0-b4a5-f20997bdbd89 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:46.973861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a29cb-eafb-44d0-b4a5-f20997bdbd89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:46.982815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a29cb-eafb-44d0-b4a5-f20997bdbd89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:46.984580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a29cb-eafb-44d0-b4a5-f20997bdbd89 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:46.994060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 686/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:58:49.471717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92806a0-85f5-4bb7-ae19-0f726bcf88cf None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:49.472255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92806a0-85f5-4bb7-ae19-0f726bcf88cf None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:49.472538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92806a0-85f5-4bb7-ae19-0f726bcf88cf None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:49.474063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 675/1361] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:49.479311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02952cb6-97b1-4af8-9f22-a1406c39927b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:49.479827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02952cb6-97b1-4af8-9f22-a1406c39927b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:49.479925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02952cb6-97b1-4af8-9f22-a1406c39927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:49.497879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-02952cb6-97b1-4af8-9f22-a1406c39927b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:49.499058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-02952cb6-97b1-4af8-9f22-a1406c39927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:49.508914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 687/1362] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:49.552127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92806a0-85f5-4bb7-ae19-0f726bcf88cf None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:49.567518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92806a0-85f5-4bb7-ae19-0f726bcf88cf None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:49.573828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5791d-0dc7-462b-a165-efcd9f04a2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:49.574546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5791d-0dc7-462b-a165-efcd9f04a2ef service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:49.574922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5791d-0dc7-462b-a165-efcd9f04a2ef service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:49.575270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5791d-0dc7-462b-a165-efcd9f04a2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:49.583716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5791d-0dc7-462b-a165-efcd9f04a2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:49.585407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5791d-0dc7-462b-a165-efcd9f04a2ef service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:49.597794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 676/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:52.196209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281ff2a-2305-4d9f-a977-491e5eb5dc83 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:52.197125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281ff2a-2305-4d9f-a977-491e5eb5dc83 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:52.197578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281ff2a-2305-4d9f-a977-491e5eb5dc83 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:52.203645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 688/1364] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:52.207109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51757-4f82-4ede-8ffa-e14dd89562e9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:52.207109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51757-4f82-4ede-8ffa-e14dd89562e9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:52.207109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51757-4f82-4ede-8ffa-e14dd89562e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:52.224769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9bd51757-4f82-4ede-8ffa-e14dd89562e9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:52.226118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9bd51757-4f82-4ede-8ffa-e14dd89562e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:52.233884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 677/1365] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:52.279704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0ee0-d529-4ba2-aab0-93b2a39854e0 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:52.279993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0ee0-d529-4ba2-aab0-93b2a39854e0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:52.280264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0ee0-d529-4ba2-aab0-93b2a39854e0 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:52.281643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 689/1366] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 18:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:52.286832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692418-99d1-496b-bb49-71fba918970b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:52.287182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692418-99d1-496b-bb49-71fba918970b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:52.287452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692418-99d1-496b-bb49-71fba918970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:52.305013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-62692418-99d1-496b-bb49-71fba918970b None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:52.306399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-62692418-99d1-496b-bb49-71fba918970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:52.315343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 678/1367] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 18:58:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:52.323349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0ee0-d529-4ba2-aab0-93b2a39854e0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:52.337550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0ee0-d529-4ba2-aab0-93b2a39854e0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:52.342985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071e2c-3002-499f-94b8-413c92390e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:52.343606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071e2c-3002-499f-94b8-413c92390e2e service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:52.343881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071e2c-3002-499f-94b8-413c92390e2e service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:52.344151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071e2c-3002-499f-94b8-413c92390e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:52.352424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071e2c-3002-499f-94b8-413c92390e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:52.353998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071e2c-3002-499f-94b8-413c92390e2e service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:52.363335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 690/1368] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:54.760740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275140f-a2d1-4b66-8e45-508736b464f4 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:54.761257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275140f-a2d1-4b66-8e45-508736b464f4 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:54.761555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275140f-a2d1-4b66-8e45-508736b464f4 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:54.762957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 679/1369] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:54.768438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31472-d449-47cd-828a-3cff15b05d56 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:54.769456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31472-d449-47cd-828a-3cff15b05d56 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:54.769936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31472-d449-47cd-828a-3cff15b05d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:54.788150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-19d31472-d449-47cd-828a-3cff15b05d56 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:54.789661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-19d31472-d449-47cd-828a-3cff15b05d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:54.802188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 691/1370] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:54.842648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275140f-a2d1-4b66-8e45-508736b464f4 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:54.857587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275140f-a2d1-4b66-8e45-508736b464f4 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:54.863313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6719897-ae47-4b03-b008-6152a1b05e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:54.864086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719897-ae47-4b03-b008-6152a1b05e42 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:54.864468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719897-ae47-4b03-b008-6152a1b05e42 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:54.864842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719897-ae47-4b03-b008-6152a1b05e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:54.873986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719897-ae47-4b03-b008-6152a1b05e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:54.875680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719897-ae47-4b03-b008-6152a1b05e42 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:54.886136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 680/1371] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:54.895637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95585036-365d-470b-a25b-2a8910c7ea59 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:54.896181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95585036-365d-470b-a25b-2a8910c7ea59 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:54.896737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95585036-365d-470b-a25b-2a8910c7ea59 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:54.898499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 692/1372] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:58:54.904150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5517-5670-46aa-aca9-d40be1d0bd52 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:54.904457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5517-5670-46aa-aca9-d40be1d0bd52 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:54.904748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5517-5670-46aa-aca9-d40be1d0bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:54.923185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b2cd5517-5670-46aa-aca9-d40be1d0bd52 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:54.925116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b2cd5517-5670-46aa-aca9-d40be1d0bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:54.935336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 681/1373] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:55.252214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221d18-ce70-4760-ad6a-6c35c97d0587 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:55.252518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221d18-ce70-4760-ad6a-6c35c97d0587 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:55.252793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221d18-ce70-4760-ad6a-6c35c97d0587 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:55.255054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 693/1374] 10.222.0.69 () {54 vars in 963 bytes} [Wed May 4 18:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:55.259317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762586a-c99f-4047-8b01-3cbbca3139e1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:55.259710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762586a-c99f-4047-8b01-3cbbca3139e1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:55.260088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762586a-c99f-4047-8b01-3cbbca3139e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:55.319000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d762586a-c99f-4047-8b01-3cbbca3139e1 None None] MFA Rules not processed for user `e39540c05b40402786e682d974ee6018`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:55.320370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d762586a-c99f-4047-8b01-3cbbca3139e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:55.383308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 682/1375] 10.222.0.69 () {58 vars in 1060 bytes} [Wed May 4 18:58:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:55.391302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51221d18-ce70-4760-ad6a-6c35c97d0587 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:55.402570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51221d18-ce70-4760-ad6a-6c35c97d0587 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:55.406026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57475f7-52a8-4f32-bf34-66c7c3b681ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:55.406654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57475f7-52a8-4f32-bf34-66c7c3b681ea service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:55.407042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57475f7-52a8-4f32-bf34-66c7c3b681ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:55.407321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57475f7-52a8-4f32-bf34-66c7c3b681ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:55.416668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57475f7-52a8-4f32-bf34-66c7c3b681ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:55.418230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57475f7-52a8-4f32-bf34-66c7c3b681ea service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:55.427525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 694/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:57.200950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789defc-56e1-40ba-865f-d1865f7ecbbc None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:57.201454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789defc-56e1-40ba-865f-d1865f7ecbbc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:57.201454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789defc-56e1-40ba-865f-d1865f7ecbbc None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:57.202833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 683/1377] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:57.208241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f9e3-07cd-472d-a573-c63a3f457f50 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:57.208655 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f9e3-07cd-472d-a573-c63a3f457f50 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:57.208792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f9e3-07cd-472d-a573-c63a3f457f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:57.227390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2394f9e3-07cd-472d-a573-c63a3f457f50 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:57.228584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2394f9e3-07cd-472d-a573-c63a3f457f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:57.236428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 695/1378] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:57.280623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789defc-56e1-40ba-865f-d1865f7ecbbc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:57.295015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789defc-56e1-40ba-865f-d1865f7ecbbc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:57.300615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68d53-1227-4572-b3db-de1a6513ce3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:57.301254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68d53-1227-4572-b3db-de1a6513ce3c service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:57.301560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68d53-1227-4572-b3db-de1a6513ce3c service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:57.301839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68d53-1227-4572-b3db-de1a6513ce3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:57.310943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68d53-1227-4572-b3db-de1a6513ce3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:57.312551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68d53-1227-4572-b3db-de1a6513ce3c service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:57.322377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 684/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:59.601734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f248c7-cb8b-4c97-91cf-cf024cf5e33e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:59.602327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f248c7-cb8b-4c97-91cf-cf024cf5e33e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:59.602327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f248c7-cb8b-4c97-91cf-cf024cf5e33e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:59.603776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 696/1380] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:58:59.608615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620453-2ef8-470b-ac12-6111a7b96d24 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:59.609045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620453-2ef8-470b-ac12-6111a7b96d24 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:59.609150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620453-2ef8-470b-ac12-6111a7b96d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:59.626398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ba620453-2ef8-470b-ac12-6111a7b96d24 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:59.627564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ba620453-2ef8-470b-ac12-6111a7b96d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:59.636105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 685/1381] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:59.679312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f248c7-cb8b-4c97-91cf-cf024cf5e33e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:59.693626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f248c7-cb8b-4c97-91cf-cf024cf5e33e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:59.699915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0e258-ea70-4631-9b93-cbde563a3139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:59.700681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e258-ea70-4631-9b93-cbde563a3139 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:59.701073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e258-ea70-4631-9b93-cbde563a3139 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:59.701499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0e258-ea70-4631-9b93-cbde563a3139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:59.709515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0e258-ea70-4631-9b93-cbde563a3139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:59.711802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0e258-ea70-4631-9b93-cbde563a3139 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:59.721266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 697/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:02.014078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9985f-1439-4e7b-9eae-d446d8c3e72a None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:02.014621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9985f-1439-4e7b-9eae-d446d8c3e72a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:02.014621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9985f-1439-4e7b-9eae-d446d8c3e72a None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:02.016008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 686/1383] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:02.021760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d308-5ee6-42aa-a910-d43ccc6e3b3d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:02.022229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d308-5ee6-42aa-a910-d43ccc6e3b3d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:02.022334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d308-5ee6-42aa-a910-d43ccc6e3b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:02.040132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6cd1d308-5ee6-42aa-a910-d43ccc6e3b3d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:02.041318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6cd1d308-5ee6-42aa-a910-d43ccc6e3b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:02.049061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 698/1384] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:02.090836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9985f-1439-4e7b-9eae-d446d8c3e72a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:02.104866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9985f-1439-4e7b-9eae-d446d8c3e72a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:02.110499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fd495-96a8-415f-94c2-1bbc0ac864eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:02.111212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fd495-96a8-415f-94c2-1bbc0ac864eb service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:02.111492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fd495-96a8-415f-94c2-1bbc0ac864eb service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:02.111788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fd495-96a8-415f-94c2-1bbc0ac864eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:02.120997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fd495-96a8-415f-94c2-1bbc0ac864eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:02.122817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fd495-96a8-415f-94c2-1bbc0ac864eb service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:02.137601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 687/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:04.706774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f68c-59ac-4175-bef4-8c78e98f61ac None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:04.707367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f68c-59ac-4175-bef4-8c78e98f61ac None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:04.707574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f68c-59ac-4175-bef4-8c78e98f61ac None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:04.709430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 699/1386] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:04.714540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb427-8e57-464d-bb9a-915d3b15cd3d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:04.714930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb427-8e57-464d-bb9a-915d3b15cd3d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:04.715081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb427-8e57-464d-bb9a-915d3b15cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:04.732990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-38beb427-8e57-464d-bb9a-915d3b15cd3d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:04.734192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-38beb427-8e57-464d-bb9a-915d3b15cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:04.743039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 688/1387] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:04.787088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849f68c-59ac-4175-bef4-8c78e98f61ac None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:04.801398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849f68c-59ac-4175-bef4-8c78e98f61ac None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:04.806738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84818b1-f416-498e-a24b-722e7fcc22b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:04.807359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84818b1-f416-498e-a24b-722e7fcc22b0 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:04.807638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84818b1-f416-498e-a24b-722e7fcc22b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:04.807901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84818b1-f416-498e-a24b-722e7fcc22b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:04.815617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84818b1-f416-498e-a24b-722e7fcc22b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:04.817232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84818b1-f416-498e-a24b-722e7fcc22b0 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:04.826677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 700/1388] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:07.088928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52d21-cfa3-4bdd-8eaf-03ff6853f7e3 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:07.089513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52d21-cfa3-4bdd-8eaf-03ff6853f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:07.089742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52d21-cfa3-4bdd-8eaf-03ff6853f7e3 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:07.091566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 689/1389] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:07.096598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c62a3-7d8a-4de6-8de9-141d61ae3808 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:07.097029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c62a3-7d8a-4de6-8de9-141d61ae3808 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:07.097127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c62a3-7d8a-4de6-8de9-141d61ae3808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:07.114726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b76c62a3-7d8a-4de6-8de9-141d61ae3808 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:07.115907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b76c62a3-7d8a-4de6-8de9-141d61ae3808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:07.124295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 701/1390] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:59:07.167786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52d21-cfa3-4bdd-8eaf-03ff6853f7e3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:07.182756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52d21-cfa3-4bdd-8eaf-03ff6853f7e3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:07.188082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a902-e829-430a-a721-df4e397db4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:07.188715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a902-e829-430a-a721-df4e397db4f4 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:07.188994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a902-e829-430a-a721-df4e397db4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:07.189264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a902-e829-430a-a721-df4e397db4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:07.197522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a902-e829-430a-a721-df4e397db4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:07.199127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a902-e829-430a-a721-df4e397db4f4 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:07.208137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 690/1391] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:59:09.481491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0431-f803-4587-889c-bfaafb8a2245 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:09.482113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0431-f803-4587-889c-bfaafb8a2245 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:09.482113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0431-f803-4587-889c-bfaafb8a2245 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:09.483411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 702/1392] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:09.488531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf25205-2adf-4b1a-a953-475b36c8f682 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:09.488965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf25205-2adf-4b1a-a953-475b36c8f682 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:09.489152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf25205-2adf-4b1a-a953-475b36c8f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:09.506588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9cf25205-2adf-4b1a-a953-475b36c8f682 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:09.508276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9cf25205-2adf-4b1a-a953-475b36c8f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:09.516221 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 691/1393] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:09.559706 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d0431-f803-4587-889c-bfaafb8a2245 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:09.575694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d0431-f803-4587-889c-bfaafb8a2245 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:09.580917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d02f2d-8880-4840-8b11-b80fdc951634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:09.581571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02f2d-8880-4840-8b11-b80fdc951634 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:09.581846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02f2d-8880-4840-8b11-b80fdc951634 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:09.582112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02f2d-8880-4840-8b11-b80fdc951634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:09.590598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d02f2d-8880-4840-8b11-b80fdc951634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:09.592161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d02f2d-8880-4840-8b11-b80fdc951634 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:09.602327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 703/1394] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:11.021856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936251be-f590-4cd7-81b6-23b4c3b347a9 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.022395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936251be-f590-4cd7-81b6-23b4c3b347a9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.022395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936251be-f590-4cd7-81b6-23b4c3b347a9 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.024395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 692/1395] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:11.029615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ffe36-c8f0-4ed3-a102-d0fbe5ef53c6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.030048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ffe36-c8f0-4ed3-a102-d0fbe5ef53c6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.030303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ffe36-c8f0-4ed3-a102-d0fbe5ef53c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.047821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e46ffe36-c8f0-4ed3-a102-d0fbe5ef53c6 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:11.049007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e46ffe36-c8f0-4ed3-a102-d0fbe5ef53c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:11.056685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 704/1396] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:11.111691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba2f50-376d-4a06-96db-55cfa256546e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.111978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba2f50-376d-4a06-96db-55cfa256546e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.112255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba2f50-376d-4a06-96db-55cfa256546e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.113636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 693/1397] 10.222.0.69 () {54 vars in 962 bytes} [Wed May 4 18:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:11.118915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef28e-813d-4bed-a7cb-2a140cc5fafe None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.119202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef28e-813d-4bed-a7cb-2a140cc5fafe None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.119478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef28e-813d-4bed-a7cb-2a140cc5fafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.165951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-08eef28e-813d-4bed-a7cb-2a140cc5fafe None None] MFA Rules not processed for user `eb9c380955a04c24af2823e22fe3ec70`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:11.167131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-08eef28e-813d-4bed-a7cb-2a140cc5fafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:11.223725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 705/1398] 10.222.0.69 () {58 vars in 1059 bytes} [Wed May 4 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:11.231402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba2f50-376d-4a06-96db-55cfa256546e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:11.241646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba2f50-376d-4a06-96db-55cfa256546e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:11.245529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f2adf-b802-410d-9cb5-cd933c15d134 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9c380955a04c24af2823e22fe3ec70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:11.246169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2adf-b802-410d-9cb5-cd933c15d134 service glance] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.246443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2adf-b802-410d-9cb5-cd933c15d134 service glance] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.246711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2adf-b802-410d-9cb5-cd933c15d134 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.255230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f2adf-b802-410d-9cb5-cd933c15d134 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:11.256635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f2adf-b802-410d-9cb5-cd933c15d134 service glance] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:11.266360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 694/1399] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:11.674255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ef566-c9a1-4a58-b795-db8d0dc6421f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.674539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ef566-c9a1-4a58-b795-db8d0dc6421f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.674816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ef566-c9a1-4a58-b795-db8d0dc6421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.727724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-770ef566-c9a1-4a58-b795-db8d0dc6421f None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:11.728937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-770ef566-c9a1-4a58-b795-db8d0dc6421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:11.790147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 706/1400] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:11.831256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908e45-7069-4cd7-be1c-4b0261772819 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.831545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908e45-7069-4cd7-be1c-4b0261772819 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.831822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908e45-7069-4cd7-be1c-4b0261772819 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.833633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 695/1401] 10.222.0.69 () {54 vars in 942 bytes} [Wed May 4 18:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:11.839796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658e81-eb28-47e6-a278-4bf9d46a2aad None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.840154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658e81-eb28-47e6-a278-4bf9d46a2aad None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.840443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658e81-eb28-47e6-a278-4bf9d46a2aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.887538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-03658e81-eb28-47e6-a278-4bf9d46a2aad None None] MFA Rules not processed for user `0e9763d8a5c040ce876a787bed7fc954`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:11.887740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2d76-abc6-4ce2-8e8c-3e27ff419dd9 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.887885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2d76-abc6-4ce2-8e8c-3e27ff419dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.888091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2d76-abc6-4ce2-8e8c-3e27ff419dd9 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.888722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-03658e81-eb28-47e6-a278-4bf9d46a2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:11.889452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 696/1402] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:59:11.894449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b30e5-0505-45fa-a01a-951e0331325b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.894736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b30e5-0505-45fa-a01a-951e0331325b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.895012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b30e5-0505-45fa-a01a-951e0331325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.913472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ab8b30e5-0505-45fa-a01a-951e0331325b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:11.915343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ab8b30e5-0505-45fa-a01a-951e0331325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:11.923367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 697/1403] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:59:11.966538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 707/1404] 10.222.0.69 () {58 vars in 1039 bytes} [Wed May 4 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:11.967116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b30e5-0505-45fa-a01a-951e0331325b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:11.975751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03658e81-eb28-47e6-a278-4bf9d46a2aad None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:11.980185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b30e5-0505-45fa-a01a-951e0331325b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:11.985451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fa6ab-b1f1-426f-9c12-bd3832f3be26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:11.985694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03658e81-eb28-47e6-a278-4bf9d46a2aad None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:11.986126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fa6ab-b1f1-426f-9c12-bd3832f3be26 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.986404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fa6ab-b1f1-426f-9c12-bd3832f3be26 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.986679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fa6ab-b1f1-426f-9c12-bd3832f3be26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.990702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a92d28-c92d-4803-99c2-d395fbc8e2d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:11.991331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92d28-c92d-4803-99c2-d395fbc8e2d8 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:11.991613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92d28-c92d-4803-99c2-d395fbc8e2d8 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:11.991915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92d28-c92d-4803-99c2-d395fbc8e2d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:11.994718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fa6ab-b1f1-426f-9c12-bd3832f3be26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:11.996269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fa6ab-b1f1-426f-9c12-bd3832f3be26 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:12.000250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a92d28-c92d-4803-99c2-d395fbc8e2d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:12.001834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a92d28-c92d-4803-99c2-d395fbc8e2d8 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:12.005497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 698/1405] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:59:12.009716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 708/1406] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 18:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:59:14.317252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40979-6953-4605-a249-472a2c19aefa None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:14.318181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40979-6953-4605-a249-472a2c19aefa None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:14.318463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40979-6953-4605-a249-472a2c19aefa None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:14.320041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 699/1407] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 18:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:14.325035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1001100-ed0a-402a-aacc-98730456e5f8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:14.325456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1001100-ed0a-402a-aacc-98730456e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:14.325622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1001100-ed0a-402a-aacc-98730456e5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:14.343866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c1001100-ed0a-402a-aacc-98730456e5f8 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:14.345060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c1001100-ed0a-402a-aacc-98730456e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:14.357431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 709/1408] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:14.401270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d40979-6953-4605-a249-472a2c19aefa None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:14.420033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d40979-6953-4605-a249-472a2c19aefa None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:14.425413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe03f08-b52c-49d5-9ab9-e877109c9012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:14.426156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe03f08-b52c-49d5-9ab9-e877109c9012 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:14.426431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe03f08-b52c-49d5-9ab9-e877109c9012 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:14.426704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe03f08-b52c-49d5-9ab9-e877109c9012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:14.435581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe03f08-b52c-49d5-9ab9-e877109c9012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:14.437218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe03f08-b52c-49d5-9ab9-e877109c9012 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:14.446399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 700/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:35.759145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f32f-9157-401d-99bf-11685bfb0305 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:35.759780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f32f-9157-401d-99bf-11685bfb0305 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:35.759780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f32f-9157-401d-99bf-11685bfb0305 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:35.761038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 710/1410] 10.222.0.69 () {54 vars in 918 bytes} [Wed May 4 18:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:35.766391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8947-d1bb-499b-8ed0-d30f132d243b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:35.766847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8947-d1bb-499b-8ed0-d30f132d243b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:35.766945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8947-d1bb-499b-8ed0-d30f132d243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:35.784437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-bece8947-d1bb-499b-8ed0-d30f132d243b None None] MFA Rules not processed for user `4eba1582c17e4df991452d433cbe567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:35.785646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bece8947-d1bb-499b-8ed0-d30f132d243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:35.794457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 701/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Wed May 4 18:59:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:35.809208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f139b6-7f8f-406e-8125-f16b63d4a6f6 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:35.809523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f139b6-7f8f-406e-8125-f16b63d4a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:35.809800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f139b6-7f8f-406e-8125-f16b63d4a6f6 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:35.811125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 711/1412] 10.222.0.69 () {54 vars in 918 bytes} [Wed May 4 18:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:35.815634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cbf93-2b17-4645-ab01-3bd5b92e631f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:35.815922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cbf93-2b17-4645-ab01-3bd5b92e631f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:35.816198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cbf93-2b17-4645-ab01-3bd5b92e631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:35.833444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b74cbf93-2b17-4645-ab01-3bd5b92e631f None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:35.834729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b74cbf93-2b17-4645-ab01-3bd5b92e631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:35.843985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 702/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Wed May 4 18:59:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:38.576329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10452ac-39a4-436b-b9bf-31c7dbdbdcc1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:38.576959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10452ac-39a4-436b-b9bf-31c7dbdbdcc1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:38.576959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10452ac-39a4-436b-b9bf-31c7dbdbdcc1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:38.578277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:38.583336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd869a-56ad-4521-b1ff-5bc02e67b815 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:38.583784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd869a-56ad-4521-b1ff-5bc02e67b815 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:38.583893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd869a-56ad-4521-b1ff-5bc02e67b815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:38.601490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-dbfd869a-56ad-4521-b1ff-5bc02e67b815 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:38.602658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-dbfd869a-56ad-4521-b1ff-5bc02e67b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:38.610231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:38.651962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10452ac-39a4-436b-b9bf-31c7dbdbdcc1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:38.666270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10452ac-39a4-436b-b9bf-31c7dbdbdcc1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:38.671549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aa1c8-0068-456e-8de5-8abb8d0083f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:38.672171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa1c8-0068-456e-8de5-8abb8d0083f4 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:38.672451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa1c8-0068-456e-8de5-8abb8d0083f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:38.672728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa1c8-0068-456e-8de5-8abb8d0083f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:38.681058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1aa1c8-0068-456e-8de5-8abb8d0083f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:38.682638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1aa1c8-0068-456e-8de5-8abb8d0083f4 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:38.691572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 713/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:39.996798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c35c6-1cab-48b9-ba16-de9462a4830e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:39.997297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c35c6-1cab-48b9-ba16-de9462a4830e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:39.997394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c35c6-1cab-48b9-ba16-de9462a4830e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:39.998745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:59:40.003801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792718b6-8d23-43cb-adf9-9389f7a4de5c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:40.004236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792718b6-8d23-43cb-adf9-9389f7a4de5c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:40.004666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792718b6-8d23-43cb-adf9-9389f7a4de5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:40.022022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-792718b6-8d23-43cb-adf9-9389f7a4de5c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:40.023205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-792718b6-8d23-43cb-adf9-9389f7a4de5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:40.030783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:40.195149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c35c6-1cab-48b9-ba16-de9462a4830e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:40.208907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c35c6-1cab-48b9-ba16-de9462a4830e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:40.214207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6905f-c859-41fe-90ff-35ed4d635a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:40.214835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6905f-c859-41fe-90ff-35ed4d635a7c service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:40.215112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6905f-c859-41fe-90ff-35ed4d635a7c service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:40.215387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6905f-c859-41fe-90ff-35ed4d635a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:40.223152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6905f-c859-41fe-90ff-35ed4d635a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:40.224717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6905f-c859-41fe-90ff-35ed4d635a7c service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:40.234221 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 705/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:41.474930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75483-5905-42e1-90c8-75e88b8d0fbf None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:41.475511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75483-5905-42e1-90c8-75e88b8d0fbf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:41.475625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75483-5905-42e1-90c8-75e88b8d0fbf None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:41.477484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:41.482572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5159-f807-4e54-83d0-b4e2d49bc1ec None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:41.483014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5159-f807-4e54-83d0-b4e2d49bc1ec None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:41.483128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5159-f807-4e54-83d0-b4e2d49bc1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:41.501090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-52ab5159-f807-4e54-83d0-b4e2d49bc1ec None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:41.502315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-52ab5159-f807-4e54-83d0-b4e2d49bc1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:41.510130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:41.660917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced75483-5905-42e1-90c8-75e88b8d0fbf None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:41.675248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced75483-5905-42e1-90c8-75e88b8d0fbf None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:41.681172 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101c076-655e-4be6-8559-bf165e2b78d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:41.681837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101c076-655e-4be6-8559-bf165e2b78d3 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:41.682116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101c076-655e-4be6-8559-bf165e2b78d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:41.682388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101c076-655e-4be6-8559-bf165e2b78d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:41.690225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101c076-655e-4be6-8559-bf165e2b78d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:41.691793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101c076-655e-4be6-8559-bf165e2b78d3 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:41.700881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 716/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:42.942828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c10b-f8aa-4be1-a156-9e4cebdb10cb None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:42.943365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c10b-f8aa-4be1-a156-9e4cebdb10cb None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:42.943365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c10b-f8aa-4be1-a156-9e4cebdb10cb None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:42.945289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:42.950247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e51cb-340a-4d80-a676-4ae7aee67d20 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:42.950679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e51cb-340a-4d80-a676-4ae7aee67d20 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:42.950776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e51cb-340a-4d80-a676-4ae7aee67d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:42.968355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-242e51cb-340a-4d80-a676-4ae7aee67d20 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:42.969585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-242e51cb-340a-4d80-a676-4ae7aee67d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:42.977903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:43.127414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c10b-f8aa-4be1-a156-9e4cebdb10cb None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:43.141104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c10b-f8aa-4be1-a156-9e4cebdb10cb None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:43.146613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec988db4-a468-49c6-b641-43c9c1a3c886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:43.147246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec988db4-a468-49c6-b641-43c9c1a3c886 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:43.147520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec988db4-a468-49c6-b641-43c9c1a3c886 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:43.147891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec988db4-a468-49c6-b641-43c9c1a3c886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:43.155653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec988db4-a468-49c6-b641-43c9c1a3c886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:43.157209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec988db4-a468-49c6-b641-43c9c1a3c886 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:43.166713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 708/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:44.391432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a151c4-9ab2-49db-a66e-15d54df7c29f None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:44.392007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a151c4-9ab2-49db-a66e-15d54df7c29f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:44.392007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a151c4-9ab2-49db-a66e-15d54df7c29f None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:44.393371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:44.398634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e141-1dec-431e-ada7-fedf54d05113 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:44.399068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e141-1dec-431e-ada7-fedf54d05113 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:44.399206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e141-1dec-431e-ada7-fedf54d05113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:44.416765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8b14e141-1dec-431e-ada7-fedf54d05113 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:44.417981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8b14e141-1dec-431e-ada7-fedf54d05113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:44.425689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:44.574589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a151c4-9ab2-49db-a66e-15d54df7c29f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:44.589146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a151c4-9ab2-49db-a66e-15d54df7c29f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:44.617540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030279-2fe2-4202-b98e-b4d5c8839ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:44.618201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030279-2fe2-4202-b98e-b4d5c8839ea0 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:44.618478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030279-2fe2-4202-b98e-b4d5c8839ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:44.618748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030279-2fe2-4202-b98e-b4d5c8839ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:44.629139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030279-2fe2-4202-b98e-b4d5c8839ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:44.630737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030279-2fe2-4202-b98e-b4d5c8839ea0 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:44.640316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 719/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:45.828846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eba5-6afa-4f1c-8f5f-4cbd77901201 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:45.829394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eba5-6afa-4f1c-8f5f-4cbd77901201 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:45.829529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eba5-6afa-4f1c-8f5f-4cbd77901201 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:45.830919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:45.836251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc1fe-0f22-4387-8968-d9a4f9bcb35e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:45.836665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc1fe-0f22-4387-8968-d9a4f9bcb35e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:45.836830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc1fe-0f22-4387-8968-d9a4f9bcb35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:45.854858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5b5bc1fe-0f22-4387-8968-d9a4f9bcb35e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:45.856063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5b5bc1fe-0f22-4387-8968-d9a4f9bcb35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:45.863646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:46.012177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2eba5-6afa-4f1c-8f5f-4cbd77901201 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:46.026971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2eba5-6afa-4f1c-8f5f-4cbd77901201 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:46.032165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bf808-b3ac-4a12-9c89-7ef4ac5f45a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:46.032789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bf808-b3ac-4a12-9c89-7ef4ac5f45a9 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:46.033065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bf808-b3ac-4a12-9c89-7ef4ac5f45a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:46.033336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bf808-b3ac-4a12-9c89-7ef4ac5f45a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:46.041022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bf808-b3ac-4a12-9c89-7ef4ac5f45a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:46.042624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bf808-b3ac-4a12-9c89-7ef4ac5f45a9 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:46.051500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 711/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:59:47.236512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a516c-225d-447f-9da4-a2284930454c None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:47.237044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a516c-225d-447f-9da4-a2284930454c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:47.237044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a516c-225d-447f-9da4-a2284930454c None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:47.238383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:47.243738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff59a-4994-41e4-abd3-f09ef1380729 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:47.244170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff59a-4994-41e4-abd3-f09ef1380729 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:47.244293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff59a-4994-41e4-abd3-f09ef1380729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:47.262990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d49ff59a-4994-41e4-abd3-f09ef1380729 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:47.264167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d49ff59a-4994-41e4-abd3-f09ef1380729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:47.272029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:47.422507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a516c-225d-447f-9da4-a2284930454c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:47.436703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a516c-225d-447f-9da4-a2284930454c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:47.441963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21923a33-f788-4a41-87af-c35759bc34ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:47.442581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923a33-f788-4a41-87af-c35759bc34ba service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:47.442856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923a33-f788-4a41-87af-c35759bc34ba service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:47.443126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923a33-f788-4a41-87af-c35759bc34ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:47.451396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21923a33-f788-4a41-87af-c35759bc34ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:47.452940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21923a33-f788-4a41-87af-c35759bc34ba service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:47.461851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 722/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:59:48.650870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98476190-c974-4caf-8c42-1fecc03bb1c9 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:48.651438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98476190-c974-4caf-8c42-1fecc03bb1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:48.651438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98476190-c974-4caf-8c42-1fecc03bb1c9 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:48.652761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:48.657594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49181-8d46-487e-8832-12dd7c238ae3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:48.658037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49181-8d46-487e-8832-12dd7c238ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:48.658173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49181-8d46-487e-8832-12dd7c238ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:48.675365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-44a49181-8d46-487e-8832-12dd7c238ae3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:48.676540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-44a49181-8d46-487e-8832-12dd7c238ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:48.684627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:48.830961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98476190-c974-4caf-8c42-1fecc03bb1c9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:48.844784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98476190-c974-4caf-8c42-1fecc03bb1c9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:48.850010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83672261-17ac-4530-a674-f7273e8e9ffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:48.850634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672261-17ac-4530-a674-f7273e8e9ffe service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:48.850913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672261-17ac-4530-a674-f7273e8e9ffe service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:48.851187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672261-17ac-4530-a674-f7273e8e9ffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:48.858946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83672261-17ac-4530-a674-f7273e8e9ffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:48.860528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83672261-17ac-4530-a674-f7273e8e9ffe service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:48.870021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 714/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:50.051981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8e21-2c99-4d7d-bb08-a94779186028 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:50.052515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8e21-2c99-4d7d-bb08-a94779186028 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:50.052605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8e21-2c99-4d7d-bb08-a94779186028 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:50.054003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:50.059481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a78f6-4998-46fb-9d9a-ecb842ee46a6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:50.059902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a78f6-4998-46fb-9d9a-ecb842ee46a6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:50.060032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a78f6-4998-46fb-9d9a-ecb842ee46a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:50.077480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-904a78f6-4998-46fb-9d9a-ecb842ee46a6 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:50.078664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-904a78f6-4998-46fb-9d9a-ecb842ee46a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:50.086798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:50.239133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8e21-2c99-4d7d-bb08-a94779186028 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:50.252946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8e21-2c99-4d7d-bb08-a94779186028 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:50.258253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137de2fb-6c7a-4bc8-9f8b-85fc7eed98d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:50.258882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137de2fb-6c7a-4bc8-9f8b-85fc7eed98d0 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:50.259159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137de2fb-6c7a-4bc8-9f8b-85fc7eed98d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:50.259437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137de2fb-6c7a-4bc8-9f8b-85fc7eed98d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:50.267299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137de2fb-6c7a-4bc8-9f8b-85fc7eed98d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:50.269127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137de2fb-6c7a-4bc8-9f8b-85fc7eed98d0 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:50.279008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 725/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:52.412967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aac96-fbe1-49c9-aab9-0113a4cc7f4f None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:52.413539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aac96-fbe1-49c9-aab9-0113a4cc7f4f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:52.413638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aac96-fbe1-49c9-aab9-0113a4cc7f4f None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:52.414934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:52.420223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc71e3-b507-4316-9fb6-3dc1cf5e511d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:52.420632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc71e3-b507-4316-9fb6-3dc1cf5e511d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:52.420766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc71e3-b507-4316-9fb6-3dc1cf5e511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:52.440359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4edc71e3-b507-4316-9fb6-3dc1cf5e511d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:52.441771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4edc71e3-b507-4316-9fb6-3dc1cf5e511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:52.451308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:52.489205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aac96-fbe1-49c9-aab9-0113a4cc7f4f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:52.500056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aac96-fbe1-49c9-aab9-0113a4cc7f4f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:52.503545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c060b39-981e-430c-b61d-ca4497074888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:52.504170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c060b39-981e-430c-b61d-ca4497074888 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:52.504445 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c060b39-981e-430c-b61d-ca4497074888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:52.504716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c060b39-981e-430c-b61d-ca4497074888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:52.514316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c060b39-981e-430c-b61d-ca4497074888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:52.515753 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c060b39-981e-430c-b61d-ca4497074888 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:52.524999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 717/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:54.882914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92a0bc-257a-4fe2-a4d7-459054e88efe None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:54.883460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92a0bc-257a-4fe2-a4d7-459054e88efe None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:54.883460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92a0bc-257a-4fe2-a4d7-459054e88efe None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:54.884749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:54.889906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13e73-e6ac-4e84-8e7d-b5f46d395a99 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:54.890328 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13e73-e6ac-4e84-8e7d-b5f46d395a99 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:54.890443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13e73-e6ac-4e84-8e7d-b5f46d395a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:54.908270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2ad13e73-e6ac-4e84-8e7d-b5f46d395a99 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:54.909452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2ad13e73-e6ac-4e84-8e7d-b5f46d395a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:54.917785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:54.954729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92a0bc-257a-4fe2-a4d7-459054e88efe None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:54.965764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92a0bc-257a-4fe2-a4d7-459054e88efe None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:54.969210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8778-bdfa-45a5-97cd-a4e9a71b421a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:54.969943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8778-bdfa-45a5-97cd-a4e9a71b421a service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:54.970223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8778-bdfa-45a5-97cd-a4e9a71b421a service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:54.970493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8778-bdfa-45a5-97cd-a4e9a71b421a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:54.979277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d8778-bdfa-45a5-97cd-a4e9a71b421a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:54.980682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d8778-bdfa-45a5-97cd-a4e9a71b421a service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:54.989698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 728/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:57.552044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924ff3-fab3-4584-9fe0-359d89e3e650 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:57.552640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924ff3-fab3-4584-9fe0-359d89e3e650 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:57.552640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924ff3-fab3-4584-9fe0-359d89e3e650 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:57.554643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:59:57.559746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3979-35f0-46d1-92c9-7111b256f594 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:57.560210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3979-35f0-46d1-92c9-7111b256f594 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:57.560321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3979-35f0-46d1-92c9-7111b256f594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:57.577599 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bb1a3979-35f0-46d1-92c9-7111b256f594 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:57.578769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bb1a3979-35f0-46d1-92c9-7111b256f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:57.586803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:57.624965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924ff3-fab3-4584-9fe0-359d89e3e650 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:57.626639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e6924ff3-fab3-4584-9fe0-359d89e3e650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:57.639229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924ff3-fab3-4584-9fe0-359d89e3e650 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:57.642598 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefc189-cab7-4c1a-973e-78cb5aa06e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:57.643226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefc189-cab7-4c1a-973e-78cb5aa06e7b service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:57.643502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefc189-cab7-4c1a-973e-78cb5aa06e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:57.644028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefc189-cab7-4c1a-973e-78cb5aa06e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:57.653021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefc189-cab7-4c1a-973e-78cb5aa06e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:57.654453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefc189-cab7-4c1a-973e-78cb5aa06e7b service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:57.664370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 720/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 18:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:00.035840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97217bd1-b203-4e4f-bb2d-3d7de01c7ea8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:00.036399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97217bd1-b203-4e4f-bb2d-3d7de01c7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:00.036399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97217bd1-b203-4e4f-bb2d-3d7de01c7ea8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:00.037805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:00.043170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb68cc6-4c1b-4a92-8fbb-6e04ebbd64f5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:00.043619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb68cc6-4c1b-4a92-8fbb-6e04ebbd64f5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:00.043738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb68cc6-4c1b-4a92-8fbb-6e04ebbd64f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:00.061131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5eb68cc6-4c1b-4a92-8fbb-6e04ebbd64f5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:00.062341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5eb68cc6-4c1b-4a92-8fbb-6e04ebbd64f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:00.070495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:00.107892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97217bd1-b203-4e4f-bb2d-3d7de01c7ea8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:00.118742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97217bd1-b203-4e4f-bb2d-3d7de01c7ea8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:00.122413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4eb27-14fe-4ac7-8e40-8a8b6dbf2ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:00.123050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4eb27-14fe-4ac7-8e40-8a8b6dbf2ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:00.123360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4eb27-14fe-4ac7-8e40-8a8b6dbf2ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:00.123634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4eb27-14fe-4ac7-8e40-8a8b6dbf2ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:00.133035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4eb27-14fe-4ac7-8e40-8a8b6dbf2ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:00.134472 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4eb27-14fe-4ac7-8e40-8a8b6dbf2ba5 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:00.143405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 731/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:02.430111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfe1b-3047-4a15-9e53-ce25ea2a8fc3 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:02.430682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfe1b-3047-4a15-9e53-ce25ea2a8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:02.430783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfe1b-3047-4a15-9e53-ce25ea2a8fc3 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:02.432112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:02.437360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa307e-07dc-4335-930a-92f89f896c84 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:02.437820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa307e-07dc-4335-930a-92f89f896c84 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:02.437925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa307e-07dc-4335-930a-92f89f896c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:02.456202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-74aa307e-07dc-4335-930a-92f89f896c84 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:02.457409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-74aa307e-07dc-4335-930a-92f89f896c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:02.465751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:00:02.503144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cfe1b-3047-4a15-9e53-ce25ea2a8fc3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:02.513958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cfe1b-3047-4a15-9e53-ce25ea2a8fc3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:02.517369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1789-2756-47d6-a606-87086d87b471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:02.518034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1789-2756-47d6-a606-87086d87b471 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:02.518312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1789-2756-47d6-a606-87086d87b471 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:02.518590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1789-2756-47d6-a606-87086d87b471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:02.528021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac1789-2756-47d6-a606-87086d87b471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:02.529439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac1789-2756-47d6-a606-87086d87b471 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:02.538726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 723/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:04.914919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0b2d1-f50d-4a11-bd02-a10981a55605 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:04.915451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0b2d1-f50d-4a11-bd02-a10981a55605 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:04.915451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0b2d1-f50d-4a11-bd02-a10981a55605 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:04.916752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:04.921916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75850af-205c-4230-9df6-838402b2e394 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:04.922310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75850af-205c-4230-9df6-838402b2e394 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:04.922462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75850af-205c-4230-9df6-838402b2e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:04.940174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b75850af-205c-4230-9df6-838402b2e394 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:04.941357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b75850af-205c-4230-9df6-838402b2e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:04.948925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:04.986197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0b2d1-f50d-4a11-bd02-a10981a55605 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:04.996999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0b2d1-f50d-4a11-bd02-a10981a55605 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:05.000450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08692ef4-f9d5-4582-8a68-834113064c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:05.001068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692ef4-f9d5-4582-8a68-834113064c5c service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.001342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692ef4-f9d5-4582-8a68-834113064c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.001643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692ef4-f9d5-4582-8a68-834113064c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.010105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692ef4-f9d5-4582-8a68-834113064c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:05.011496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692ef4-f9d5-4582-8a68-834113064c5c service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:05.020619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 734/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:07.311315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3992c-30f8-4e54-a090-306cd407de95 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:07.311871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3992c-30f8-4e54-a090-306cd407de95 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:07.312190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3992c-30f8-4e54-a090-306cd407de95 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:07.314348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:00:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:07.320042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd9f1b-a685-47c8-9121-efd150fbbf51 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:07.320486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd9f1b-a685-47c8-9121-efd150fbbf51 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:07.320598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd9f1b-a685-47c8-9121-efd150fbbf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:07.339914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e0bd9f1b-a685-47c8-9121-efd150fbbf51 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:07.341070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e0bd9f1b-a685-47c8-9121-efd150fbbf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:07.348816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:07.386082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3992c-30f8-4e54-a090-306cd407de95 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:07.396779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3992c-30f8-4e54-a090-306cd407de95 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:07.400298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d0740-a70a-44d7-ab4e-410aa478810f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:07.400930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d0740-a70a-44d7-ab4e-410aa478810f service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:07.401219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d0740-a70a-44d7-ab4e-410aa478810f service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:07.401521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d0740-a70a-44d7-ab4e-410aa478810f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:07.410184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d0740-a70a-44d7-ab4e-410aa478810f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:07.411602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d0740-a70a-44d7-ab4e-410aa478810f service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:07.420732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 726/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:09.711902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4f6f-5b99-44f9-88fb-54381c9093da None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:09.712474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4f6f-5b99-44f9-88fb-54381c9093da None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:09.712474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4f6f-5b99-44f9-88fb-54381c9093da None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:09.713842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:09.719007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e26ff-3973-4756-9d66-1cb33074da90 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:09.719460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e26ff-3973-4756-9d66-1cb33074da90 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:09.719558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e26ff-3973-4756-9d66-1cb33074da90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:09.737042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8b8e26ff-3973-4756-9d66-1cb33074da90 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:09.738235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8b8e26ff-3973-4756-9d66-1cb33074da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:09.745746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:09.782837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4f6f-5b99-44f9-88fb-54381c9093da None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:09.793778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4f6f-5b99-44f9-88fb-54381c9093da None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:09.797199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50483d8-c107-4c1f-ad45-788a36faf876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:09.797860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50483d8-c107-4c1f-ad45-788a36faf876 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:09.798139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50483d8-c107-4c1f-ad45-788a36faf876 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:09.798413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50483d8-c107-4c1f-ad45-788a36faf876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:09.806914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50483d8-c107-4c1f-ad45-788a36faf876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:09.808334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50483d8-c107-4c1f-ad45-788a36faf876 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:09.817338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 737/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:12.056033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d15357-7c3c-49a7-9e9b-7dfc8b429b19 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:12.056560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d15357-7c3c-49a7-9e9b-7dfc8b429b19 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:12.056675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d15357-7c3c-49a7-9e9b-7dfc8b429b19 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:12.057988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:12.063253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572a8bf-600f-4f8d-8cd9-7393803d926f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:12.063654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572a8bf-600f-4f8d-8cd9-7393803d926f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:12.063835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572a8bf-600f-4f8d-8cd9-7393803d926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:12.081531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8572a8bf-600f-4f8d-8cd9-7393803d926f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:12.082713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8572a8bf-600f-4f8d-8cd9-7393803d926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:12.090481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:12.126140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d15357-7c3c-49a7-9e9b-7dfc8b429b19 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:12.136994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d15357-7c3c-49a7-9e9b-7dfc8b429b19 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:12.140403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f9101-e7b3-4609-b5b5-4b650add3fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:12.141024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f9101-e7b3-4609-b5b5-4b650add3fca service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:12.141299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f9101-e7b3-4609-b5b5-4b650add3fca service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:12.141601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f9101-e7b3-4609-b5b5-4b650add3fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:12.150300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f9101-e7b3-4609-b5b5-4b650add3fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:12.151704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f9101-e7b3-4609-b5b5-4b650add3fca service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:12.160738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 729/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:14.381651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e904-78aa-4ed4-b099-cbd6f858a17e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:14.382206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e904-78aa-4ed4-b099-cbd6f858a17e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:14.382206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e904-78aa-4ed4-b099-cbd6f858a17e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:14.383554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:14.388803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275a20-86f1-4c32-9f8d-d4e60adc8873 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:14.389254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275a20-86f1-4c32-9f8d-d4e60adc8873 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:14.389382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275a20-86f1-4c32-9f8d-d4e60adc8873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:14.407412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-37275a20-86f1-4c32-9f8d-d4e60adc8873 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:14.408594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-37275a20-86f1-4c32-9f8d-d4e60adc8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:14.416817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:14.452475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e904-78aa-4ed4-b099-cbd6f858a17e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:14.463579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e904-78aa-4ed4-b099-cbd6f858a17e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:14.467019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ee58-6121-4032-9c05-2ae91bcf151e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:14.467653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ee58-6121-4032-9c05-2ae91bcf151e service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:14.467923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ee58-6121-4032-9c05-2ae91bcf151e service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:14.468193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ee58-6121-4032-9c05-2ae91bcf151e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:14.476760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239ee58-6121-4032-9c05-2ae91bcf151e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:14.478221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239ee58-6121-4032-9c05-2ae91bcf151e service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:14.487292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 740/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:47.564433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e4f8-f4c6-4e0a-9942-82c11768611f None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:47.564996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e4f8-f4c6-4e0a-9942-82c11768611f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:47.564996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e4f8-f4c6-4e0a-9942-82c11768611f None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:47.566406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 731/1471] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 19:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:47.571769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8972-5aa0-494b-a216-6ec145155e0a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:47.572202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8972-5aa0-494b-a216-6ec145155e0a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:47.572349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8972-5aa0-494b-a216-6ec145155e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:47.589811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e91a8972-5aa0-494b-a216-6ec145155e0a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:47.590988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e91a8972-5aa0-494b-a216-6ec145155e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:47.599015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 741/1472] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 19:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:47.645873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8894-4f3a-4772-9fe6-441d649f3c54 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:47.646162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8894-4f3a-4772-9fe6-441d649f3c54 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:47.646441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8894-4f3a-4772-9fe6-441d649f3c54 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:47.647787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 732/1473] 10.222.0.69 () {54 vars in 962 bytes} [Wed May 4 19:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:47.652752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e942d-2070-46dd-a5b6-28d0bb1d7faf None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:47.653032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e942d-2070-46dd-a5b6-28d0bb1d7faf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:47.653313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e942d-2070-46dd-a5b6-28d0bb1d7faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:47.671484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-292e942d-2070-46dd-a5b6-28d0bb1d7faf None None] MFA Rules not processed for user `eb9c380955a04c24af2823e22fe3ec70`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:47.672665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-292e942d-2070-46dd-a5b6-28d0bb1d7faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:47.679868 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 742/1474] 10.222.0.69 () {58 vars in 1059 bytes} [Wed May 4 19:00:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:00:47.687154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da8894-4f3a-4772-9fe6-441d649f3c54 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:47.697300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da8894-4f3a-4772-9fe6-441d649f3c54 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:47.700709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c722b1-16a7-4ce9-9c38-89d1bd2cecb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9c380955a04c24af2823e22fe3ec70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:47.701339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c722b1-16a7-4ce9-9c38-89d1bd2cecb7 service glance] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:47.701681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c722b1-16a7-4ce9-9c38-89d1bd2cecb7 service glance] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:47.701954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c722b1-16a7-4ce9-9c38-89d1bd2cecb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:47.710356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c722b1-16a7-4ce9-9c38-89d1bd2cecb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:47.711763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c722b1-16a7-4ce9-9c38-89d1bd2cecb7 service glance] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:47.720727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 733/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:50.078892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8686cd-0b26-40aa-9769-e351834fff81 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:50.079468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8686cd-0b26-40aa-9769-e351834fff81 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:50.079468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8686cd-0b26-40aa-9769-e351834fff81 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:50.080813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 743/1476] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 19:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:50.086585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be0fc-f5c8-4233-b510-b2b67b3990b3 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:50.087013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be0fc-f5c8-4233-b510-b2b67b3990b3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:50.087170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037be0fc-f5c8-4233-b510-b2b67b3990b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:50.104112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-037be0fc-f5c8-4233-b510-b2b67b3990b3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:50.105289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-037be0fc-f5c8-4233-b510-b2b67b3990b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:50.112879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 734/1477] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 19:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:00:50.136461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8686cd-0b26-40aa-9769-e351834fff81 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:50.148614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8686cd-0b26-40aa-9769-e351834fff81 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:50.152880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680cc6d-ca9b-4e09-9dc1-b7b3135ec9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:50.153551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680cc6d-ca9b-4e09-9dc1-b7b3135ec9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:50.153832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680cc6d-ca9b-4e09-9dc1-b7b3135ec9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:50.154103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680cc6d-ca9b-4e09-9dc1-b7b3135ec9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:50.154820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680cc6d-ca9b-4e09-9dc1-b7b3135ec9b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:50.156554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-b680cc6d-ca9b-4e09-9dc1-b7b3135ec9b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:00:50.156554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:00:50.156554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:00:50.157722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680cc6d-ca9b-4e09-9dc1-b7b3135ec9b3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:50.175825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 744/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 19:00:50 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:00:52.435748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996e14-8cdb-4830-af76-4d05be7a674f None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:52.436317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996e14-8cdb-4830-af76-4d05be7a674f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:52.436402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996e14-8cdb-4830-af76-4d05be7a674f None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:52.437786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 735/1479] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 19:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:52.444899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0aa4-36e3-497b-bc6f-39d7a1b28322 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:52.445364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0aa4-36e3-497b-bc6f-39d7a1b28322 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:52.445503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0aa4-36e3-497b-bc6f-39d7a1b28322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:52.463560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a24d0aa4-36e3-497b-bc6f-39d7a1b28322 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:52.464754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a24d0aa4-36e3-497b-bc6f-39d7a1b28322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:52.472583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 745/1480] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 19:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:00:52.513974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97996e14-8cdb-4830-af76-4d05be7a674f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:52.529185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97996e14-8cdb-4830-af76-4d05be7a674f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:52.534646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510b76-9fdc-4090-aea2-3d94100af457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:52.535270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510b76-9fdc-4090-aea2-3d94100af457 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:52.535546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510b76-9fdc-4090-aea2-3d94100af457 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:52.535899 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510b76-9fdc-4090-aea2-3d94100af457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:52.544611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510b76-9fdc-4090-aea2-3d94100af457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:52.546228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510b76-9fdc-4090-aea2-3d94100af457 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:52.555289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 736/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:54.950215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743ce6-c3e3-429c-b69b-b6662f01cbe8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:54.950744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743ce6-c3e3-429c-b69b-b6662f01cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:54.950744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743ce6-c3e3-429c-b69b-b6662f01cbe8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:54.952035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 746/1482] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 19:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:54.957095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b590cf-932d-4d29-982c-9035ce197264 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:54.957524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b590cf-932d-4d29-982c-9035ce197264 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:54.957747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b590cf-932d-4d29-982c-9035ce197264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:54.978147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-02b590cf-932d-4d29-982c-9035ce197264 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:54.980052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-02b590cf-932d-4d29-982c-9035ce197264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:54.990038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 737/1483] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 19:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:55.027858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743ce6-c3e3-429c-b69b-b6662f01cbe8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:55.038879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743ce6-c3e3-429c-b69b-b6662f01cbe8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:55.042317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4d3bc-ffac-4390-9611-2c05c6a03efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:55.042938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4d3bc-ffac-4390-9611-2c05c6a03efc service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:55.043211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4d3bc-ffac-4390-9611-2c05c6a03efc service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:55.043759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4d3bc-ffac-4390-9611-2c05c6a03efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:55.052917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4d3bc-ffac-4390-9611-2c05c6a03efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:55.054350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4d3bc-ffac-4390-9611-2c05c6a03efc service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:55.063311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 747/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:57.357321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fa70f-9222-4dd1-8103-565b51cc89cb None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:57.357973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fa70f-9222-4dd1-8103-565b51cc89cb None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:57.357973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fa70f-9222-4dd1-8103-565b51cc89cb None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:57.359275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 738/1485] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 19:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:57.365036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d670491-6c51-4f15-ad4e-c228a3e3ea2c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:57.365458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d670491-6c51-4f15-ad4e-c228a3e3ea2c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:57.365633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d670491-6c51-4f15-ad4e-c228a3e3ea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:57.382722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2d670491-6c51-4f15-ad4e-c228a3e3ea2c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:57.383896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2d670491-6c51-4f15-ad4e-c228a3e3ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:57.391487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 748/1486] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 19:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:57.428755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fa70f-9222-4dd1-8103-565b51cc89cb None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:57.439305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fa70f-9222-4dd1-8103-565b51cc89cb None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:57.442740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce8643-5aac-42b3-a776-add4e19e65ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:57.443361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce8643-5aac-42b3-a776-add4e19e65ab service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:57.443636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce8643-5aac-42b3-a776-add4e19e65ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:57.443903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce8643-5aac-42b3-a776-add4e19e65ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:57.452363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce8643-5aac-42b3-a776-add4e19e65ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:57.453794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce8643-5aac-42b3-a776-add4e19e65ab service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:57.462731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 739/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:59.781843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928e6e1-5841-415c-8c88-f4f2d1bd37b4 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:59.782430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928e6e1-5841-415c-8c88-f4f2d1bd37b4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:59.782430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928e6e1-5841-415c-8c88-f4f2d1bd37b4 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:59.783749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 749/1488] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 19:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:59.789314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e79a0e-7b8e-4032-96d3-98c2d2bb5573 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:59.789727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e79a0e-7b8e-4032-96d3-98c2d2bb5573 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:59.789901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e79a0e-7b8e-4032-96d3-98c2d2bb5573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:59.807506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-74e79a0e-7b8e-4032-96d3-98c2d2bb5573 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:59.808680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-74e79a0e-7b8e-4032-96d3-98c2d2bb5573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:59.816217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 740/1489] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 19:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:59.855899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928e6e1-5841-415c-8c88-f4f2d1bd37b4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:59.866099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928e6e1-5841-415c-8c88-f4f2d1bd37b4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:59.869450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b98d1-5a0a-48fb-81b9-2864a8f2d3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:59.870096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b98d1-5a0a-48fb-81b9-2864a8f2d3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:59.870370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b98d1-5a0a-48fb-81b9-2864a8f2d3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:59.870640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b98d1-5a0a-48fb-81b9-2864a8f2d3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:59.879147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b98d1-5a0a-48fb-81b9-2864a8f2d3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:59.880551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b98d1-5a0a-48fb-81b9-2864a8f2d3f4 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:59.889549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 750/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:01:02.385290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf555e-513f-44cc-83f1-7d93ee1f7cfb None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:02.385890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf555e-513f-44cc-83f1-7d93ee1f7cfb None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:02.385890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf555e-513f-44cc-83f1-7d93ee1f7cfb None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:02.387258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 741/1491] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 19:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:01:02.392409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3467-2aba-44b0-8c37-2a000a5cf5af None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:02.392796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3467-2aba-44b0-8c37-2a000a5cf5af None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:02.392965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3467-2aba-44b0-8c37-2a000a5cf5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:02.411594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3d7f3467-2aba-44b0-8c37-2a000a5cf5af None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:01:02.412781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3d7f3467-2aba-44b0-8c37-2a000a5cf5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:01:02.420419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 751/1492] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 19:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:01:02.458806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf555e-513f-44cc-83f1-7d93ee1f7cfb None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:01:02.469208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf555e-513f-44cc-83f1-7d93ee1f7cfb None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:01:02.472713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeabce-057b-4696-9df8-6d8b0aa70bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:01:02.473867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeabce-057b-4696-9df8-6d8b0aa70bcc service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:02.474181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeabce-057b-4696-9df8-6d8b0aa70bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:02.474452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeabce-057b-4696-9df8-6d8b0aa70bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:02.483092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeabce-057b-4696-9df8-6d8b0aa70bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:01:02.484513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeabce-057b-4696-9df8-6d8b0aa70bcc service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:01:02.494192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 742/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:30.957146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c5ef-1751-4219-8688-4dec407ab4d0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:30.957738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c5ef-1751-4219-8688-4dec407ab4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:30.957738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c5ef-1751-4219-8688-4dec407ab4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:30.975352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d573c5ef-1751-4219-8688-4dec407ab4d0 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:30.976574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d573c5ef-1751-4219-8688-4dec407ab4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:30.984289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 752/1494] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:30.991998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366146-8342-45b1-9c3a-0cb0917aea6f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:30.992431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366146-8342-45b1-9c3a-0cb0917aea6f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:30.992534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366146-8342-45b1-9c3a-0cb0917aea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.010226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4d366146-8342-45b1-9c3a-0cb0917aea6f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:31.011386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4d366146-8342-45b1-9c3a-0cb0917aea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:31.019846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 743/1495] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:31.024023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c5ef-1751-4219-8688-4dec407ab4d0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.033128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c5ef-1751-4219-8688-4dec407ab4d0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.037575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.038209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.038484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.038753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.039457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:02:31.039752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.040733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:31.040733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:02:31.040733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:02:31.041621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.052458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 753/1496] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:02:31.060361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366146-8342-45b1-9c3a-0cb0917aea6f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.069566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366146-8342-45b1-9c3a-0cb0917aea6f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.073936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.074569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.074850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.075122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.075785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.077594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING py.warnings [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:31.077594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: warnings.warn(msg) May 04 19:02:31.077594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: May 04 19:02:31.079397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.112242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 744/1497] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:02:31 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:31.116307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.126346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e33d9c-a9bc-46e6-af92-95b78a6bcbe4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.178884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.179531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.179811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.180081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.180756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.181791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:31.181791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:02:31.181791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:02:31.182989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.201973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 754/1498] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:02:31 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:02:31.206629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.216601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37fd88-6b8f-45fc-a275-8e17b2a42253 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.220990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.221659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.221938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.222207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.222915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.223910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING py.warnings [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:31.223910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: warnings.warn(msg) May 04 19:02:31.223910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: May 04 19:02:31.224782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.239259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 745/1499] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:31.243269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.253203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2459e5c-a754-4d6b-ac08-7ad999c438f2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.257679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cca0f6-d0c3-4a5d-8162-f4f143a0b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.258317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cca0f6-d0c3-4a5d-8162-f4f143a0b422 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.258592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cca0f6-d0c3-4a5d-8162-f4f143a0b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.258862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cca0f6-d0c3-4a5d-8162-f4f143a0b422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.259592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cca0f6-d0c3-4a5d-8162-f4f143a0b422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.260584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-16cca0f6-d0c3-4a5d-8162-f4f143a0b422 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:31.260584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:02:31.260584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:02:31.261491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cca0f6-d0c3-4a5d-8162-f4f143a0b422 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.274969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 755/1500] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:31.278846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.288402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6108166-f80c-4cdc-8db0-f5184c128643 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.292851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.293781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.294052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.294315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] PATH_INFO: `/v3/projects/901d3f60fbc1459c88ecc9ae22ecbcf9/users/ee77a7d4349b45849a9ae84bab78cbf6/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.308183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] RBAC: Authorizing `identity:create_grant(project_id=901d3f60fbc1459c88ecc9ae22ecbcf9, user_id=ee77a7d4349b45849a9ae84bab78cbf6, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.309180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING py.warnings [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:31.309180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: warnings.warn(msg) May 04 19:02:31.309180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: May 04 19:02:31.311134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.324054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 746/1501] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:02:31 2022] PUT /identity/v3/projects/901d3f60fbc1459c88ecc9ae22ecbcf9/users/ee77a7d4349b45849a9ae84bab78cbf6/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:31.335999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd974-bfb4-4bd9-a072-4f904b54b7cb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.336303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd974-bfb4-4bd9-a072-4f904b54b7cb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.336560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd974-bfb4-4bd9-a072-4f904b54b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.365022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-793cd974-bfb4-4bd9-a072-4f904b54b7cb None None] MFA Rules not processed for user `ee77a7d4349b45849a9ae84bab78cbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:31.366254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-793cd974-bfb4-4bd9-a072-4f904b54b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:31.427331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 756/1502] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:02:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:31.438871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.504614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ffb3-c786-4744-86c4-797a16b465db admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.509890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.510525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.510803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.511076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.518774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.520345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.528887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 747/1503] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:31.597300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8688e4-f21a-435b-ae9e-7a6dc1f946c4 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.597623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8688e4-f21a-435b-ae9e-7a6dc1f946c4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.597900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8688e4-f21a-435b-ae9e-7a6dc1f946c4 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.599181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 757/1504] 10.222.0.69 () {52 vars in 829 bytes} [Wed May 4 19:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:02:31.602886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.661201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ea908-141f-4fc3-b53a-0f4d46242e85 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.665634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.666479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.666754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.667022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] PATH_INFO: `/v3/users/ee77a7d4349b45849a9ae84bab78cbf6` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.668165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee77a7d4349b45849a9ae84bab78cbf6)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.669155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING py.warnings [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:31.669155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: warnings.warn(msg) May 04 19:02:31.669155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: May 04 19:02:31.670369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.731748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee77a7d4349b45849a9ae84bab78cbf6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:31.744283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee77a7d4349b45849a9ae84bab78cbf6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:31.744952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee77a7d4349b45849a9ae84bab78cbf6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:31.753686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee77a7d4349b45849a9ae84bab78cbf6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:31.754379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee77a7d4349b45849a9ae84bab78cbf6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:31.777457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 748/1505] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:02:31 2022] DELETE /identity/v3/users/ee77a7d4349b45849a9ae84bab78cbf6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:31.782311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.782597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.782870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.800153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:31.801323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:31.855375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 758/1506] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:31.865319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:31.866769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:31.921633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582a04-178b-4634-ac65-66d1ff4369f0 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:31.925790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169c69-7ed5-46eb-8e3c-1d47c2b79845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:31.926435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169c69-7ed5-46eb-8e3c-1d47c2b79845 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:31.926715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169c69-7ed5-46eb-8e3c-1d47c2b79845 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:31.926986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169c69-7ed5-46eb-8e3c-1d47c2b79845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:31.935739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169c69-7ed5-46eb-8e3c-1d47c2b79845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:31.937159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169c69-7ed5-46eb-8e3c-1d47c2b79845 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:31.946370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 749/1507] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:32.265217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:32.267250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:32.279891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147603-8005-441f-8d1b-1c27d3f77be3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:32.285236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:32.286337 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:32.286620 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:32.286893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] PATH_INFO: `/v3/projects/901d3f60fbc1459c88ecc9ae22ecbcf9` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:32.288078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=901d3f60fbc1459c88ecc9ae22ecbcf9)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:32.289087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:02:32.289087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:02:32.289087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:02:32.290666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:32.348381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901d3f60fbc1459c88ecc9ae22ecbcf9', 'request_id': 'req-5c186f5d-0824-4743-86e0-fa42fbb4fa00'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:32.354545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901d3f60fbc1459c88ecc9ae22ecbcf9', 'request_id': 'req-5c186f5d-0824-4743-86e0-fa42fbb4fa00'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:32.364190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901d3f60fbc1459c88ecc9ae22ecbcf9', 'request_id': 'req-5c186f5d-0824-4743-86e0-fa42fbb4fa00'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:32.381981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] The token cache is being invalidate because project 901d3f60fbc1459c88ecc9ae22ecbcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:32.382264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:32.382986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c186f5d-0824-4743-86e0-fa42fbb4fa00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:32.384516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 759/1508] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:02:32 2022] DELETE /identity/v3/projects/901d3f60fbc1459c88ecc9ae22ecbcf9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:10.367027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63eba1-9a67-44ea-a68f-981406fc4c7e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:10.367619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63eba1-9a67-44ea-a68f-981406fc4c7e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:10.367619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63eba1-9a67-44ea-a68f-981406fc4c7e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:10.368976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 750/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 19:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:10.373721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5552b1-6f2c-42a8-9c5c-8b914417898d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:10.374168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5552b1-6f2c-42a8-9c5c-8b914417898d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:10.374322 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5552b1-6f2c-42a8-9c5c-8b914417898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:10.392281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3d5552b1-6f2c-42a8-9c5c-8b914417898d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:10.393864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3d5552b1-6f2c-42a8-9c5c-8b914417898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:10.450061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 760/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 19:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:10.601404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63eba1-9a67-44ea-a68f-981406fc4c7e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:10.603087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1b63eba1-9a67-44ea-a68f-981406fc4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:10.675198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63eba1-9a67-44ea-a68f-981406fc4c7e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:10.680460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9678d-f441-4988-b3ff-8fb0e82f9ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:10.681098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9678d-f441-4988-b3ff-8fb0e82f9ec5 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:10.681380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9678d-f441-4988-b3ff-8fb0e82f9ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:10.681682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9678d-f441-4988-b3ff-8fb0e82f9ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:10.689517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9678d-f441-4988-b3ff-8fb0e82f9ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:10.691103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9678d-f441-4988-b3ff-8fb0e82f9ec5 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:10.700139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 751/1511] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:11.131687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d84e-ad39-4a64-97af-6ad689906da9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:11.132072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d84e-ad39-4a64-97af-6ad689906da9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:11.132422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d84e-ad39-4a64-97af-6ad689906da9 None None] PATH_INFO: `/v3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:11.133828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 761/1512] 10.222.0.11 () {54 vars in 925 bytes} [Wed May 4 19:04:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:04:11.140545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a4b8-7a53-479f-a9ed-e6188b60b60a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:11.140835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a4b8-7a53-479f-a9ed-e6188b60b60a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:11.141114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a4b8-7a53-479f-a9ed-e6188b60b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:11.159487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2c68a4b8-7a53-479f-a9ed-e6188b60b60a None None] MFA Rules not processed for user `4eba1582c17e4df991452d433cbe567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:11.160660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2c68a4b8-7a53-479f-a9ed-e6188b60b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:11.223589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 752/1513] 10.222.0.11 () {58 vars in 1015 bytes} [Wed May 4 19:04:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:11.918231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087015c6-771a-450a-8af6-a0a9a92e710b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:11.918807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087015c6-771a-450a-8af6-a0a9a92e710b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:11.918807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087015c6-771a-450a-8af6-a0a9a92e710b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:11.920188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 19:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:11.925361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d815fee-cd7b-4537-bc3e-16b321f16dd5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:11.925838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d815fee-cd7b-4537-bc3e-16b321f16dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:11.925948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d815fee-cd7b-4537-bc3e-16b321f16dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:11.943904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4d815fee-cd7b-4537-bc3e-16b321f16dd5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:11.945092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4d815fee-cd7b-4537-bc3e-16b321f16dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:11.952670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 19:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:12.102464 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087015c6-771a-450a-8af6-a0a9a92e710b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:12.116677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087015c6-771a-450a-8af6-a0a9a92e710b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:12.122232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455d12d-3b1f-40fd-8090-ee35017f82c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:12.122867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d12d-3b1f-40fd-8090-ee35017f82c3 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:12.123149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d12d-3b1f-40fd-8090-ee35017f82c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:12.123424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d12d-3b1f-40fd-8090-ee35017f82c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:12.132101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455d12d-3b1f-40fd-8090-ee35017f82c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:12.133719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455d12d-3b1f-40fd-8090-ee35017f82c3 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:12.142767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 763/1516] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:20.025656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df71d-9132-4600-bc1b-aae40d133828 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:20.026132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df71d-9132-4600-bc1b-aae40d133828 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:20.026231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df71d-9132-4600-bc1b-aae40d133828 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:20.027559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 754/1517] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 19:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:20.033360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4a2c-34a6-48b2-a366-b9abe629dc64 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:20.033787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4a2c-34a6-48b2-a366-b9abe629dc64 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:20.033939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4a2c-34a6-48b2-a366-b9abe629dc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:20.051247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-309d4a2c-34a6-48b2-a366-b9abe629dc64 None None] MFA Rules not processed for user `4eba1582c17e4df991452d433cbe567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:20.052431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-309d4a2c-34a6-48b2-a366-b9abe629dc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:20.060665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 764/1518] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:20.067795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8df71d-9132-4600-bc1b-aae40d133828 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:20.080955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8df71d-9132-4600-bc1b-aae40d133828 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:20.085693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e40b13-edf8-4a0a-8830-91638779510a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:20.086307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40b13-edf8-4a0a-8830-91638779510a service placement] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:20.086586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40b13-edf8-4a0a-8830-91638779510a service placement] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:20.086857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40b13-edf8-4a0a-8830-91638779510a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:20.095423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e40b13-edf8-4a0a-8830-91638779510a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:20.097006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e40b13-edf8-4a0a-8830-91638779510a service placement] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:20.106236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 755/1519] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:23.752594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6156f-9542-46f5-89cf-a173058881da None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:23.753142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6156f-9542-46f5-89cf-a173058881da None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:23.753142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6156f-9542-46f5-89cf-a173058881da None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:23.754531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 765/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 19:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:23.759149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a38a-1b0b-4f56-a77e-7ad62f4e754e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:23.759575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a38a-1b0b-4f56-a77e-7ad62f4e754e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:23.759694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a38a-1b0b-4f56-a77e-7ad62f4e754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:23.777886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0fd5a38a-1b0b-4f56-a77e-7ad62f4e754e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:23.779059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0fd5a38a-1b0b-4f56-a77e-7ad62f4e754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:23.786792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 756/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 19:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:23.935321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6156f-9542-46f5-89cf-a173058881da None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:23.950170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6156f-9542-46f5-89cf-a173058881da None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:23.955399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262cf19-4142-4dde-9639-fac1106c564f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:23.956022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262cf19-4142-4dde-9639-fac1106c564f service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:23.956296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262cf19-4142-4dde-9639-fac1106c564f service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:23.956562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262cf19-4142-4dde-9639-fac1106c564f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:23.964726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262cf19-4142-4dde-9639-fac1106c564f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:23.966347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262cf19-4142-4dde-9639-fac1106c564f service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:23.977758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 766/1522] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:25.198026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304bc6e-3003-4e9e-a02e-03551a1ae79d None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:25.198597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304bc6e-3003-4e9e-a02e-03551a1ae79d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:25.198597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304bc6e-3003-4e9e-a02e-03551a1ae79d None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:25.199946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 757/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 19:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:25.205205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dd42-a4b7-448f-b160-7843507c1933 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:25.205679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dd42-a4b7-448f-b160-7843507c1933 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:25.205790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dd42-a4b7-448f-b160-7843507c1933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:25.223015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-84e7dd42-a4b7-448f-b160-7843507c1933 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:25.224180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-84e7dd42-a4b7-448f-b160-7843507c1933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:25.232135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 767/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 19:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:25.387804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304bc6e-3003-4e9e-a02e-03551a1ae79d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:25.402037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304bc6e-3003-4e9e-a02e-03551a1ae79d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:25.408313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06922884-bdd3-471b-95b3-11af8771a6b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:25.408938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06922884-bdd3-471b-95b3-11af8771a6b7 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:25.409216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06922884-bdd3-471b-95b3-11af8771a6b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:25.409515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06922884-bdd3-471b-95b3-11af8771a6b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:25.417301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06922884-bdd3-471b-95b3-11af8771a6b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:25.418931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06922884-bdd3-471b-95b3-11af8771a6b7 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:25.428615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 758/1525] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:29.592236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790b60-a133-4707-abd2-974d234ca294 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:29.592781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790b60-a133-4707-abd2-974d234ca294 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:29.592781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790b60-a133-4707-abd2-974d234ca294 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:29.594240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 768/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:29.599299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171efb6-7f05-4448-81b1-668ed48a9d82 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:29.599705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171efb6-7f05-4448-81b1-668ed48a9d82 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:29.599851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171efb6-7f05-4448-81b1-668ed48a9d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:29.617081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5171efb6-7f05-4448-81b1-668ed48a9d82 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:29.618332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5171efb6-7f05-4448-81b1-668ed48a9d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:29.626588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 759/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:29.664318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70790b60-a133-4707-abd2-974d234ca294 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:29.666095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-70790b60-a133-4707-abd2-974d234ca294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:29.721246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70790b60-a133-4707-abd2-974d234ca294 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:29.724701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c411a4-c857-433b-a9b8-340a206396ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:29.725324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c411a4-c857-433b-a9b8-340a206396ef service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:29.725632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c411a4-c857-433b-a9b8-340a206396ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:29.725902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c411a4-c857-433b-a9b8-340a206396ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:29.734789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c411a4-c857-433b-a9b8-340a206396ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:29.736193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c411a4-c857-433b-a9b8-340a206396ef service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:29.745073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 769/1528] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:31.991923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff920de-fa80-4534-ab10-9a0b906ae701 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:31.992407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff920de-fa80-4534-ab10-9a0b906ae701 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:31.992526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff920de-fa80-4534-ab10-9a0b906ae701 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:31.993894 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 760/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:31.998929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bb6ef-d0c6-426d-b09d-0f3b90de158d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:31.999331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bb6ef-d0c6-426d-b09d-0f3b90de158d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:31.999527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bb6ef-d0c6-426d-b09d-0f3b90de158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:32.019375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a87bb6ef-d0c6-426d-b09d-0f3b90de158d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:32.020576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a87bb6ef-d0c6-426d-b09d-0f3b90de158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:32.028311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 770/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:32.063292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff920de-fa80-4534-ab10-9a0b906ae701 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:32.073727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff920de-fa80-4534-ab10-9a0b906ae701 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:32.077198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef5dc4-c51a-48b8-a7c5-a4ca7460d4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:32.078346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef5dc4-c51a-48b8-a7c5-a4ca7460d4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:32.078621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef5dc4-c51a-48b8-a7c5-a4ca7460d4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:32.078892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef5dc4-c51a-48b8-a7c5-a4ca7460d4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:32.087374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef5dc4-c51a-48b8-a7c5-a4ca7460d4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:32.088798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef5dc4-c51a-48b8-a7c5-a4ca7460d4e1 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:32.098400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 761/1531] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:35.747947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7cc69-aac2-4a20-b454-af2391b220b0 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:35.748528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7cc69-aac2-4a20-b454-af2391b220b0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:35.748528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7cc69-aac2-4a20-b454-af2391b220b0 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:35.750511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 771/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:35.755513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf78bb-70e7-48ea-804f-d9c5babb3de2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:35.755903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf78bb-70e7-48ea-804f-d9c5babb3de2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:35.756063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf78bb-70e7-48ea-804f-d9c5babb3de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:35.773731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-feaf78bb-70e7-48ea-804f-d9c5babb3de2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:35.774937 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-feaf78bb-70e7-48ea-804f-d9c5babb3de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:35.782564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 762/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:36.050437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7cc69-aac2-4a20-b454-af2391b220b0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:36.052092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-41c7cc69-aac2-4a20-b454-af2391b220b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:36.105377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7cc69-aac2-4a20-b454-af2391b220b0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:36.109592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a9fc3-cda8-4dfa-9dd2-a6105472c2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:36.110264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9fc3-cda8-4dfa-9dd2-a6105472c2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:36.110541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9fc3-cda8-4dfa-9dd2-a6105472c2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:36.110812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9fc3-cda8-4dfa-9dd2-a6105472c2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:36.119467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a9fc3-cda8-4dfa-9dd2-a6105472c2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:36.120876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a9fc3-cda8-4dfa-9dd2-a6105472c2f4 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:36.129927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 772/1534] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:38.424657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b973ca-567f-4d2b-83d2-97017bafd807 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:38.425270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b973ca-567f-4d2b-83d2-97017bafd807 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:38.425270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b973ca-567f-4d2b-83d2-97017bafd807 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:38.426700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 763/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 19:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:38.431742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87362615-5bf1-4a9e-9ec7-38fa2252c462 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:38.432149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87362615-5bf1-4a9e-9ec7-38fa2252c462 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:38.432310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87362615-5bf1-4a9e-9ec7-38fa2252c462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:38.449654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-87362615-5bf1-4a9e-9ec7-38fa2252c462 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:38.450843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-87362615-5bf1-4a9e-9ec7-38fa2252c462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:38.458526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 773/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 19:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:38.735364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34933ac-e0b3-46dc-930a-a5512fd68573 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:38.735648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34933ac-e0b3-46dc-930a-a5512fd68573 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:38.735925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34933ac-e0b3-46dc-930a-a5512fd68573 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:38.737293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 764/1537] 10.222.0.69 () {54 vars in 963 bytes} [Wed May 4 19:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:04:38.742162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff05e5-5194-46f1-8c8b-62dc9ff67224 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:38.742445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff05e5-5194-46f1-8c8b-62dc9ff67224 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:38.742716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff05e5-5194-46f1-8c8b-62dc9ff67224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:38.759995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-08ff05e5-5194-46f1-8c8b-62dc9ff67224 None None] MFA Rules not processed for user `e39540c05b40402786e682d974ee6018`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:38.761170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-08ff05e5-5194-46f1-8c8b-62dc9ff67224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:38.768244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 774/1538] 10.222.0.69 () {58 vars in 1060 bytes} [Wed May 4 19:04:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:04:38.775610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34933ac-e0b3-46dc-930a-a5512fd68573 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:38.786606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34933ac-e0b3-46dc-930a-a5512fd68573 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:38.790065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f663c4-9554-4b8e-877f-a26e8150e8f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:38.790692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f663c4-9554-4b8e-877f-a26e8150e8f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:38.790972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f663c4-9554-4b8e-877f-a26e8150e8f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:38.791244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f663c4-9554-4b8e-877f-a26e8150e8f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:38.799766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f663c4-9554-4b8e-877f-a26e8150e8f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:38.801172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f663c4-9554-4b8e-877f-a26e8150e8f2 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:38.810246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 765/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:06.338155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d5b9-66d8-4712-aa88-f146759f149b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.338809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d5b9-66d8-4712-aa88-f146759f149b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.338809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d5b9-66d8-4712-aa88-f146759f149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.378484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b0b5d5b9-66d8-4712-aa88-f146759f149b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.380167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b0b5d5b9-66d8-4712-aa88-f146759f149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.392368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 775/1540] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:06.403751 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae1a6-25c3-4d05-8337-49db7df15ae9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.404342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae1a6-25c3-4d05-8337-49db7df15ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.404342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae1a6-25c3-4d05-8337-49db7df15ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.428647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-aefae1a6-25c3-4d05-8337-49db7df15ae9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.430050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-aefae1a6-25c3-4d05-8337-49db7df15ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.439553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648be0-6be8-43e6-8a50-9bc85670e844 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.439889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648be0-6be8-43e6-8a50-9bc85670e844 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.440156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648be0-6be8-43e6-8a50-9bc85670e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.448356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 766/1541] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.459172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae1a6-25c3-4d05-8337-49db7df15ae9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.468728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae1a6-25c3-4d05-8337-49db7df15ae9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:06.472687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2d648be0-6be8-43e6-8a50-9bc85670e844 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.473940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2d648be0-6be8-43e6-8a50-9bc85670e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.479601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:06.481265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.481580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.481859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.482645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:06.482959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:06.484116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING py.warnings [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:06:06.484116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: warnings.warn(msg) May 04 19:06:06.484116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: May 04 19:06:06.484999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:06.494703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 776/1542] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:06.496592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00cdd6-8aff-470d-8c20-98df7761560f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.496877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00cdd6-8aff-470d-8c20-98df7761560f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.497149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00cdd6-8aff-470d-8c20-98df7761560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.502249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 767/1543] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:06:06.529304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.537684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ad00cdd6-8aff-470d-8c20-98df7761560f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.539117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ad00cdd6-8aff-470d-8c20-98df7761560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.542414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd9515-a853-4244-8e15-1cfd187aa5ac admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:06.555760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44a101-498d-4933-990b-5ecd01ea5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:06.556531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a101-498d-4933-990b-5ecd01ea5a6a admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.556825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a101-498d-4933-990b-5ecd01ea5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.557200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a101-498d-4933-990b-5ecd01ea5a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.558099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44a101-498d-4933-990b-5ecd01ea5a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:06.560597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44a101-498d-4933-990b-5ecd01ea5a6a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:06.567444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 777/1544] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.568883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55c5aa-7b2f-49b2-9980-2daeebc7bb3b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.569426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55c5aa-7b2f-49b2-9980-2daeebc7bb3b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.569725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55c5aa-7b2f-49b2-9980-2daeebc7bb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.611022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9a55c5aa-7b2f-49b2-9980-2daeebc7bb3b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.612398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9a55c5aa-7b2f-49b2-9980-2daeebc7bb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.623437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 768/1545] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:06.624982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc36c-f63f-464f-8a97-78b3a1b4006e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.625271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc36c-f63f-464f-8a97-78b3a1b4006e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.625568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc36c-f63f-464f-8a97-78b3a1b4006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.628131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 778/1546] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.629551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ac432-e1dc-47fe-8b66-316c6df1fdf7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.629845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ac432-e1dc-47fe-8b66-316c6df1fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.630122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ac432-e1dc-47fe-8b66-316c6df1fdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.666691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-241ac432-e1dc-47fe-8b66-316c6df1fdf7 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.668866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-241ac432-e1dc-47fe-8b66-316c6df1fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.670097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-811fc36c-f63f-464f-8a97-78b3a1b4006e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.671287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-811fc36c-f63f-464f-8a97-78b3a1b4006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.777825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 779/1547] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.778695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ac432-e1dc-47fe-8b66-316c6df1fdf7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.781367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 769/1548] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.782287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc36c-f63f-464f-8a97-78b3a1b4006e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.793377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc36c-f63f-464f-8a97-78b3a1b4006e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:06.798382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ac432-e1dc-47fe-8b66-316c6df1fdf7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:06.807336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758af84-76f1-4a57-ab87-2d241becf6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:06.808037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758af84-76f1-4a57-ab87-2d241becf6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.808874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758af84-76f1-4a57-ab87-2d241becf6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.809152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758af84-76f1-4a57-ab87-2d241becf6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.809518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabc269-3580-46f1-afd5-82964db1095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:06.809879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758af84-76f1-4a57-ab87-2d241becf6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:06.810187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc269-3580-46f1-afd5-82964db1095e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.810465 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc269-3580-46f1-afd5-82964db1095e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.810732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc269-3580-46f1-afd5-82964db1095e admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.810907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING py.warnings [None req-0758af84-76f1-4a57-ab87-2d241becf6c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:06:06.810907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: warnings.warn(msg) May 04 19:06:06.810907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: May 04 19:06:06.811701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabc269-3580-46f1-afd5-82964db1095e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:06.812109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758af84-76f1-4a57-ab87-2d241becf6c3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:06.812284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabc269-3580-46f1-afd5-82964db1095e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:06.813877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabc269-3580-46f1-afd5-82964db1095e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:06.830365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 780/1549] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:06.832317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6eee2-7eab-49df-963f-46aa0eb5cf96 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.832797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6eee2-7eab-49df-963f-46aa0eb5cf96 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.833243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6eee2-7eab-49df-963f-46aa0eb5cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.835124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 770/1550] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:06.836805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305ae3-eecb-4872-93e6-d620fd6d9687 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.837193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305ae3-eecb-4872-93e6-d620fd6d9687 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.837646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305ae3-eecb-4872-93e6-d620fd6d9687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.852958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-def6eee2-7eab-49df-963f-46aa0eb5cf96 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.854206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-def6eee2-7eab-49df-963f-46aa0eb5cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.857044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-66305ae3-eecb-4872-93e6-d620fd6d9687 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.858693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-66305ae3-eecb-4872-93e6-d620fd6d9687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.863587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 781/1551] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.864361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6eee2-7eab-49df-963f-46aa0eb5cf96 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.869694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 771/1552] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.871226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f326c-db61-49ec-937e-9d4bb233f63a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.871617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f326c-db61-49ec-937e-9d4bb233f63a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.871928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f326c-db61-49ec-937e-9d4bb233f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.874127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6eee2-7eab-49df-963f-46aa0eb5cf96 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:06.879755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e883d-7367-449b-87b2-99318979eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:06.880213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e883d-7367-449b-87b2-99318979eb02 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.880505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e883d-7367-449b-87b2-99318979eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.880767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e883d-7367-449b-87b2-99318979eb02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.881521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e883d-7367-449b-87b2-99318979eb02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:06.881830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e883d-7367-449b-87b2-99318979eb02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:06.883450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e883d-7367-449b-87b2-99318979eb02 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:06.891449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7c9f326c-db61-49ec-937e-9d4bb233f63a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.892880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7c9f326c-db61-49ec-937e-9d4bb233f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.895034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 782/1553] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:06.896247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ee9a-8a02-4ca5-9981-4318996f6f88 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.896535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ee9a-8a02-4ca5-9981-4318996f6f88 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.896817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ee9a-8a02-4ca5-9981-4318996f6f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.901218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 772/1554] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.903010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9d6fd-cbb4-41d0-908e-5fc2b628cdae None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.903295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9d6fd-cbb4-41d0-908e-5fc2b628cdae None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.903570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9d6fd-cbb4-41d0-908e-5fc2b628cdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.918506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0403ee9a-8a02-4ca5-9981-4318996f6f88 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.919700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0403ee9a-8a02-4ca5-9981-4318996f6f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.922109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6ab9d6fd-cbb4-41d0-908e-5fc2b628cdae None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.923427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6ab9d6fd-cbb4-41d0-908e-5fc2b628cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.927502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 783/1555] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.928271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ee9a-8a02-4ca5-9981-4318996f6f88 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.937617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 773/1556] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.937806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ee9a-8a02-4ca5-9981-4318996f6f88 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:06.938947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9d6fd-cbb4-41d0-908e-5fc2b628cdae None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.942882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaeae7-468d-4b87-900f-17647cb59cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:06.943598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaeae7-468d-4b87-900f-17647cb59cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.943876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaeae7-468d-4b87-900f-17647cb59cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.944144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaeae7-468d-4b87-900f-17647cb59cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.944892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaeae7-468d-4b87-900f-17647cb59cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:06.946593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaeae7-468d-4b87-900f-17647cb59cdf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:06.948148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9d6fd-cbb4-41d0-908e-5fc2b628cdae None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:06.952565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896681ac-5fcd-49d5-9ce0-56f8132fdd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:06.953231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896681ac-5fcd-49d5-9ce0-56f8132fdd23 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.953543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896681ac-5fcd-49d5-9ce0-56f8132fdd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.953817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896681ac-5fcd-49d5-9ce0-56f8132fdd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.954485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896681ac-5fcd-49d5-9ce0-56f8132fdd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:06.956350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896681ac-5fcd-49d5-9ce0-56f8132fdd23 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:06.956612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 784/1557] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:06.960717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d81303-56cf-42db-8a35-73747f30a296 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.960717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d81303-56cf-42db-8a35-73747f30a296 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.960717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d81303-56cf-42db-8a35-73747f30a296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:06.979836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-97d81303-56cf-42db-8a35-73747f30a296 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:06.982236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-97d81303-56cf-42db-8a35-73747f30a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:06.992935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 774/1558] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:06.993121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 785/1559] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:06.993121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d81303-56cf-42db-8a35-73747f30a296 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:06.993324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310076-6e6a-49ed-91d1-86fab971335d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:06.993324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310076-6e6a-49ed-91d1-86fab971335d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:06.993324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310076-6e6a-49ed-91d1-86fab971335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.003225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d81303-56cf-42db-8a35-73747f30a296 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.011347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-50310076-6e6a-49ed-91d1-86fab971335d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:07.012551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-50310076-6e6a-49ed-91d1-86fab971335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:07.056886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747371-445b-4724-904b-f053e6f12329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.057565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747371-445b-4724-904b-f053e6f12329 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.057848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747371-445b-4724-904b-f053e6f12329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.058120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747371-445b-4724-904b-f053e6f12329 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.058819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747371-445b-4724-904b-f053e6f12329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.059817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-ed747371-445b-4724-904b-f053e6f12329 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:06:07.059817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:06:07.059817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:06:07.061010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747371-445b-4724-904b-f053e6f12329 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.068935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 775/1560] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:07.072624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310076-6e6a-49ed-91d1-86fab971335d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.078586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310076-6e6a-49ed-91d1-86fab971335d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.083652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89131cbc-2bea-4e2d-98d8-d34069eaddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.084286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131cbc-2bea-4e2d-98d8-d34069eaddbf admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.084561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131cbc-2bea-4e2d-98d8-d34069eaddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.084827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131cbc-2bea-4e2d-98d8-d34069eaddbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.085556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89131cbc-2bea-4e2d-98d8-d34069eaddbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:07.085863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89131cbc-2bea-4e2d-98d8-d34069eaddbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.090797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 786/1561] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:06 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.090962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89131cbc-2bea-4e2d-98d8-d34069eaddbf admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.091059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631fe5f-25b1-4c48-a4e9-bfced164c43f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.091059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631fe5f-25b1-4c48-a4e9-bfced164c43f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.091059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631fe5f-25b1-4c48-a4e9-bfced164c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.099360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 776/1562] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:07.100523 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98dbd5-35f1-4609-b1f6-fc959dd865f6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.100920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98dbd5-35f1-4609-b1f6-fc959dd865f6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.101103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98dbd5-35f1-4609-b1f6-fc959dd865f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.108524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3631fe5f-25b1-4c48-a4e9-bfced164c43f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:07.109760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3631fe5f-25b1-4c48-a4e9-bfced164c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:07.119133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7d98dbd5-35f1-4609-b1f6-fc959dd865f6 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:07.120217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7d98dbd5-35f1-4609-b1f6-fc959dd865f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:07.165425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 787/1563] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:07.167030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631fe5f-25b1-4c48-a4e9-bfced164c43f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.176755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 777/1564] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:07.176923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631fe5f-25b1-4c48-a4e9-bfced164c43f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.177650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98dbd5-35f1-4609-b1f6-fc959dd865f6 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.181641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.182294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.182573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.182841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.183581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.185168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.186447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98dbd5-35f1-4609-b1f6-fc959dd865f6 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.190846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.191483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.191758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.192028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.192692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.194624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.194975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 788/1565] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.195753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.205151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edcdd-941d-489b-84df-1aa4a027aa85 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.210670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.211376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.211661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.211941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.212678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:07.212991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.215238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 778/1566] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/users => generated 287 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.215375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.216017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.225013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9dca-026e-4863-bb13-2ec1781d3331 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.232932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 789/1567] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:07.232932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.236210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.236875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.237147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.237420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.238171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:07.238478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.240068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.241645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc65fc-d9d8-429d-9ec6-6e2029d64b93 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.246185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.246830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.247163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.247442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.248113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.250078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.252054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 779/1568] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:07.252823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.262670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a66fb4-e60b-417d-9bef-9f51bf5290e9 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.267442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.268331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.268611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.268887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.269589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.271133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 790/1569] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.271476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.275041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.284658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aecb7-43b2-4181-852f-d2b8a99176f8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.289826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.290501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.290785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.291062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.291774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:07.292082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.293715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.300087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 780/1570] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.300087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.312674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 791/1571] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:07.312674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.315776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466ec1-5671-4d48-8eed-fb207da486d0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.363080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ded8c-4966-4d5b-bd4a-d7ac180cd9f8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.367731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.368430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.368714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.369014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.369259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.370047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:07.370147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.370288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.370560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.370999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] PATH_INFO: `/v3/projects/e7beef313fe3439db0866cfdb10fdbe2/users/047fb46d1a764838bd8f8a44609a2e6f/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.371822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.383077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 781/1572] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:07.383920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.391950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7beef313fe3439db0866cfdb10fdbe2, user_id=047fb46d1a764838bd8f8a44609a2e6f, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.393255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:06:07.393255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:06:07.393255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:06:07.393853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328154-012b-40c3-93d9-8dcc84d22e0a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.395335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.398332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.398973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.399267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.399553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.400330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.402628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.409033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 792/1573] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:07 2022] PUT /identity/v3/projects/e7beef313fe3439db0866cfdb10fdbe2/users/047fb46d1a764838bd8f8a44609a2e6f/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:07.409942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.413088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 782/1574] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.413903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.423057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faf801-1ba3-4462-9178-1093463a3433 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.475404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71fe97-33e0-47ba-acfe-a159e8ecf0fa admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.477618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.478298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.478581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.478862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.479553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.480277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.480949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.481228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.481524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.481645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.482227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.484180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.507045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 783/1575] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.507875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.508644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 793/1576] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.509384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.569825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36010e-6c7d-4846-ba2f-1472ba1e4d69 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.572467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac78d6-49a3-497c-93e7-1da78feb9ed8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.574914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.575575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.575856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.576129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.576808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.577564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.578223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.578501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.578800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.578899 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.579512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.581073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.591870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 784/1577] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.593040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.603932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 794/1578] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.603932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.606592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edf036-c57a-4a8a-80af-69d7d1a0f847 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.611268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ec97-d715-469e-9959-e47bd99f2487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.611413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45736f-2a58-4354-b66c-3268ef9e42b8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.611915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ec97-d715-469e-9959-e47bd99f2487 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.612195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ec97-d715-469e-9959-e47bd99f2487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.612469 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ec97-d715-469e-9959-e47bd99f2487 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.613136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73ec97-d715-469e-9959-e47bd99f2487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.615072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73ec97-d715-469e-9959-e47bd99f2487 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.615935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.616569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.616850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.617124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.617825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.619770 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.642294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 785/1579] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.643828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb0263-52ae-4e68-98a8-10dfda700f07 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.644125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb0263-52ae-4e68-98a8-10dfda700f07 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.644403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb0263-52ae-4e68-98a8-10dfda700f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.649202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 795/1580] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.649202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.661499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1bdb0263-52ae-4e68-98a8-10dfda700f07 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:07.662705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1bdb0263-52ae-4e68-98a8-10dfda700f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:07.706579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734aac7-e072-4ad6-9c7b-0158cb3874f0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.711165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.711807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.712080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.712349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.713053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.714810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.718797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 786/1581] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:07.722766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb0263-52ae-4e68-98a8-10dfda700f07 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.728163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 796/1582] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.728163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.732078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb0263-52ae-4e68-98a8-10dfda700f07 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.736547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.736848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ad81e-7bcb-4151-bdca-0991b8bd7c80 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.737208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.737508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.737786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.738461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.740375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.741493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.742145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.742423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.742692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.743348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.745232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.760997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 787/1583] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.762917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.765278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 797/1584] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.766221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.773368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93f624-85bd-4a87-beec-1fb60dfe195f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.775494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003b015-4fbc-41b4-b180-b93c3a917f5f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.778006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.778656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.778936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.779209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.779966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.780089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.780594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.780869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.781135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.781583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.781865 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.783426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.791083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 788/1585] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.794371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.794786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 798/1586] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.795553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.804775 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a064-bcc2-46ea-b3bb-8cf20d647ef2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.806698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb32d0-facc-4fcc-9ba5-218966ec67a0 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.809748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.810364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.810637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.810904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.811556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.811766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.812411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.812694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.812970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.813414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.813703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.815602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.833141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 799/1587] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/users => generated 296 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.833867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.837515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 789/1588] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:07 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:07.838398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.843512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432be2a1-9b0e-4a3c-9185-7c6b0d9e5697 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.848204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.848972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.849252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.849549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] PATH_INFO: `/v3/projects/1bc7de2c2f1d4e9c88b45b11a315c7a4/users/e248b49b03e54c4ea96cace68c44f3b3/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.863399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc7de2c2f1d4e9c88b45b11a315c7a4, user_id=e248b49b03e54c4ea96cace68c44f3b3, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.867788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.880832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 800/1589] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:07 2022] PUT /identity/v3/projects/1bc7de2c2f1d4e9c88b45b11a315c7a4/users/e248b49b03e54c4ea96cace68c44f3b3/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:07.881626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.892110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ee01-e1f9-40d0-9d0d-77b87b0aeb02 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.938291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.939070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.939345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.939622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.941984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06fa7a-11f7-4033-b45e-a28a64227df9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.946471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.947116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.947391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.947653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.948359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.948466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.950468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.950605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.959823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 790/1590] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:07.960561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.962915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 801/1591] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.963954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.970847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23d93-f210-447f-bc21-b70fa235023f service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.973355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2fd1e-6a27-4aa2-9f73-6a5680852f30 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:07.975652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.976971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.977175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.977491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.978191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:07.979177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:07.979846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:07.980545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:07.980823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:07.981094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] PATH_INFO: `/v3/projects/8d4b1ea121aa45c6974feb10b0e1d5ac/users/e865228290de44c98673461df2b9333d/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:07.992519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 791/1592] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:07.993363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:07.997102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4b1ea121aa45c6974feb10b0e1d5ac, user_id=e865228290de44c98673461df2b9333d, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.000181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.005585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a750dc2-604e-4cc9-8149-fdca413573ea admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.011028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.011773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.012123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.012484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.013265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.014890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.022301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 802/1593] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:07 2022] PUT /identity/v3/projects/8d4b1ea121aa45c6974feb10b0e1d5ac/users/e865228290de44c98673461df2b9333d/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:08.022301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.025188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 792/1594] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:08.029095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.038887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49493db-4d70-47e0-b171-424af21041b0 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.090839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d1391-7fa7-4a74-a491-1d9936d6942e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.095991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea5dc-791d-4f64-919a-b59d1ec03231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.096650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea5dc-791d-4f64-919a-b59d1ec03231 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.096910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea5dc-791d-4f64-919a-b59d1ec03231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.097226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea5dc-791d-4f64-919a-b59d1ec03231 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.097981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.098144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea5dc-791d-4f64-919a-b59d1ec03231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.098761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.099105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.099441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.099697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea5dc-791d-4f64-919a-b59d1ec03231 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.100275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.101976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.110970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 803/1595] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:08.112966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 793/1596] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:08.117793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.118145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c83f-8be7-4631-bd98-1c7ee3454d6a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.118424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c83f-8be7-4631-bd98-1c7ee3454d6a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.118713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c83f-8be7-4631-bd98-1c7ee3454d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.130279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18459ff-e0f7-44b6-b6b8-a0fb1dda6c17 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.135373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.136292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.137079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.137572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.138301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.139893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.147562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4df4c83f-8be7-4631-bd98-1c7ee3454d6a None None] MFA Rules not processed for user `e248b49b03e54c4ea96cace68c44f3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:08.149208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4df4c83f-8be7-4631-bd98-1c7ee3454d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:08.155028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 794/1597] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:08.155897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.174579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbfbe9-6de7-49db-a36e-37405716ba64 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.183925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe9c0a-55df-4451-917e-544801667853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.184605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9c0a-55df-4451-917e-544801667853 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.184887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9c0a-55df-4451-917e-544801667853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.185162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9c0a-55df-4451-917e-544801667853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.186100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe9c0a-55df-4451-917e-544801667853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.187957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe9c0a-55df-4451-917e-544801667853 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.199713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 795/1598] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:08.201499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2248-9ddb-4bd2-8764-d690465abbc1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.202127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2248-9ddb-4bd2-8764-d690465abbc1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.202811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2248-9ddb-4bd2-8764-d690465abbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.227286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 804/1599] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:08.228207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4c83f-8be7-4631-bd98-1c7ee3454d6a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.233196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d58f2248-9ddb-4bd2-8764-d690465abbc1 None None] MFA Rules not processed for user `e865228290de44c98673461df2b9333d`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:08.234858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d58f2248-9ddb-4bd2-8764-d690465abbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:08.245333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4c83f-8be7-4631-bd98-1c7ee3454d6a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.252411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.253872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.254183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.254595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] PATH_INFO: `/v3/projects/df8f18c943e24a3ab621f08fa24c596b/users/d54ad9809c8241a18d88fa6cd960badd/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.274468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8f18c943e24a3ab621f08fa24c596b, user_id=d54ad9809c8241a18d88fa6cd960badd, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.277607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.300105 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 805/1600] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:08 2022] PUT /identity/v3/projects/df8f18c943e24a3ab621f08fa24c596b/users/d54ad9809c8241a18d88fa6cd960badd/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:08.304736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.329225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 796/1601] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:08.330407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2248-9ddb-4bd2-8764-d690465abbc1 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.342811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2248-9ddb-4bd2-8764-d690465abbc1 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.372984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c746c-4757-4f0d-ba02-7739f0457166 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.378883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.379530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.379802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.380100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.381058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.382928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.395060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 806/1602] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:08.398981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.410184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5eca-14c9-4b54-b835-2749f9b81740 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.416961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15a933-ba9a-43ff-b6be-3ff45e81215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.418571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15a933-ba9a-43ff-b6be-3ff45e81215a admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.418856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15a933-ba9a-43ff-b6be-3ff45e81215a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.419177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15a933-ba9a-43ff-b6be-3ff45e81215a admin admin] PATH_INFO: `/v3/projects/815a238944ab430586d4b8b3ba13eafd/users/ddcf17661a994d11a7fe54d7fee9f206/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.434820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15a933-ba9a-43ff-b6be-3ff45e81215a admin admin] RBAC: Authorizing `identity:create_grant(project_id=815a238944ab430586d4b8b3ba13eafd, user_id=ddcf17661a994d11a7fe54d7fee9f206, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.437677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15a933-ba9a-43ff-b6be-3ff45e81215a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.438047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.438818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.439318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.439607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.440399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.442025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.453099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 797/1603] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:08.454365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.459272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 807/1604] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:08 2022] PUT /identity/v3/projects/815a238944ab430586d4b8b3ba13eafd/users/ddcf17661a994d11a7fe54d7fee9f206/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:08.460247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf49f-7b7d-42b0-9ec9-b260b2e3f1ca None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.460537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf49f-7b7d-42b0-9ec9-b260b2e3f1ca None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.460893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf49f-7b7d-42b0-9ec9-b260b2e3f1ca None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.462507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 808/1605] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 19:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:08.463405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f9f56-24e7-4aae-b397-d0e0b4a28de3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.463687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f9f56-24e7-4aae-b397-d0e0b4a28de3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.463963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f9f56-24e7-4aae-b397-d0e0b4a28de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.472159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d02c84-e84b-4246-a839-558e8c693cb7 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.486845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c93f9f56-24e7-4aae-b397-d0e0b4a28de3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:08.488172 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c93f9f56-24e7-4aae-b397-d0e0b4a28de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:08.534864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.535766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.536197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.536474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] PATH_INFO: `/v3/projects/22cd825d7a4e4635bcff6fe0a5940c69/users/03223ed29ae84d7da0257be569be0319/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.550113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 809/1606] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:08.550959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f9f56-24e7-4aae-b397-d0e0b4a28de3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.552426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cd825d7a4e4635bcff6fe0a5940c69, user_id=03223ed29ae84d7da0257be569be0319, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.555326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.560091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f9f56-24e7-4aae-b397-d0e0b4a28de3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.566035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.566691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.567033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.567222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.567900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.571268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.571773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 798/1607] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:08 2022] PUT /identity/v3/projects/22cd825d7a4e4635bcff6fe0a5940c69/users/03223ed29ae84d7da0257be569be0319/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:08.572638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.609384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 810/1608] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:08 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:08.613348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.658119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19266b3-da51-497d-9192-23f8b9973925 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.698114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460776ed-4dc9-4998-8908-800d6211e235 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.706607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01562-d679-40a9-9425-0db0924ead17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.708641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01562-d679-40a9-9425-0db0924ead17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.709136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01562-d679-40a9-9425-0db0924ead17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.709612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01562-d679-40a9-9425-0db0924ead17 admin admin] PATH_INFO: `/v3/projects/5966de1f7fc9403087d0ec08be6a3085/users/47deb39e5d954424a4fb4e97375443f7/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.734136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01562-d679-40a9-9425-0db0924ead17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5966de1f7fc9403087d0ec08be6a3085, user_id=47deb39e5d954424a4fb4e97375443f7, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.735194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6246f7d-d13e-4a12-b9e9-8766dec87d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.736292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6246f7d-d13e-4a12-b9e9-8766dec87d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.736570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6246f7d-d13e-4a12-b9e9-8766dec87d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.736842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6246f7d-d13e-4a12-b9e9-8766dec87d8a admin admin] PATH_INFO: `/v3/projects/2b6009c7f43b406e850c819b5b50311c/users/719edb67e8ae41b885581ae3645dd85b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.738081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01562-d679-40a9-9425-0db0924ead17 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.760265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 811/1609] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:08 2022] PUT /identity/v3/projects/5966de1f7fc9403087d0ec08be6a3085/users/47deb39e5d954424a4fb4e97375443f7/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:08.760265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44cbd7-ac07-417e-8ede-831fac6349db None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.760265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44cbd7-ac07-417e-8ede-831fac6349db None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.760265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44cbd7-ac07-417e-8ede-831fac6349db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.766403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6246f7d-d13e-4a12-b9e9-8766dec87d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6009c7f43b406e850c819b5b50311c, user_id=719edb67e8ae41b885581ae3645dd85b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:08.769316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6246f7d-d13e-4a12-b9e9-8766dec87d8a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:08.791147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 799/1610] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:08 2022] PUT /identity/v3/projects/2b6009c7f43b406e850c819b5b50311c/users/719edb67e8ae41b885581ae3645dd85b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:08.797114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c565-dcd7-418f-9b6e-68536a25b5e4 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.797409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c565-dcd7-418f-9b6e-68536a25b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.797714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c565-dcd7-418f-9b6e-68536a25b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.799670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8d44cbd7-ac07-417e-8ede-831fac6349db None None] MFA Rules not processed for user `ddcf17661a994d11a7fe54d7fee9f206`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:08.801082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8d44cbd7-ac07-417e-8ede-831fac6349db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:08.894358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 812/1611] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:08.895346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44cbd7-ac07-417e-8ede-831fac6349db None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:08.972123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44cbd7-ac07-417e-8ede-831fac6349db None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:08.977356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265c75c-c114-4a91-8653-ca5a2f3327e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:08.978077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265c75c-c114-4a91-8653-ca5a2f3327e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:08.978352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265c75c-c114-4a91-8653-ca5a2f3327e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:08.978623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265c75c-c114-4a91-8653-ca5a2f3327e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:08.981248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-dea9c565-dcd7-418f-9b6e-68536a25b5e4 None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:08.982754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-dea9c565-dcd7-418f-9b6e-68536a25b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:09.049768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265c75c-c114-4a91-8653-ca5a2f3327e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.051231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265c75c-c114-4a91-8653-ca5a2f3327e6 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.064133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 813/1612] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:09.066237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654dba8-016e-4da8-ba13-3e98a900ceb8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.066684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654dba8-016e-4da8-ba13-3e98a900ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.067476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654dba8-016e-4da8-ba13-3e98a900ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.072787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 800/1613] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:09.072978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9c565-dcd7-418f-9b6e-68536a25b5e4 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.086003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9c565-dcd7-418f-9b6e-68536a25b5e4 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.092376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ab953-bb46-415d-8458-b55e8391ea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.093407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ab953-bb46-415d-8458-b55e8391ea7e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.093407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ab953-bb46-415d-8458-b55e8391ea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.093925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ab953-bb46-415d-8458-b55e8391ea7e admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.094683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ab953-bb46-415d-8458-b55e8391ea7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.098000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ab953-bb46-415d-8458-b55e8391ea7e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.102447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0654dba8-016e-4da8-ba13-3e98a900ceb8 None None] MFA Rules not processed for user `03223ed29ae84d7da0257be569be0319`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:09.103922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0654dba8-016e-4da8-ba13-3e98a900ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:09.132207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 801/1614] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:09 2022] POST /identity/v3/users => generated 291 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:09.132207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838a696-f059-47b0-b6d1-2314e095af8f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.132680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838a696-f059-47b0-b6d1-2314e095af8f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.133825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838a696-f059-47b0-b6d1-2314e095af8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.166782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d838a696-f059-47b0-b6d1-2314e095af8f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:09.168676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d838a696-f059-47b0-b6d1-2314e095af8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:09.180033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 802/1615] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:09.181402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44103-c41a-41b4-be87-22a055bf6386 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.181781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44103-c41a-41b4-be87-22a055bf6386 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.182122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44103-c41a-41b4-be87-22a055bf6386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.202994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 814/1616] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:09.205082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654dba8-016e-4da8-ba13-3e98a900ceb8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.222394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-27e44103-c41a-41b4-be87-22a055bf6386 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:09.223692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-27e44103-c41a-41b4-be87-22a055bf6386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:09.233622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 803/1617] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:09.234613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44103-c41a-41b4-be87-22a055bf6386 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.241257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654dba8-016e-4da8-ba13-3e98a900ceb8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.248772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.249651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.249930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.250817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.251263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44103-c41a-41b4-be87-22a055bf6386 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.251558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.254342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.257545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.258739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.259402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.260210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.300069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 815/1618] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:09 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:09.303925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.358565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.360318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.372310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 804/1619] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:09.373260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.375332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:09.390353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c469aa7-7c59-403d-b1ed-e374ebea3e0a service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.401619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba8123-7779-4535-879f-2a598cb71c60 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.408158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8c5d6-cd17-493d-b47b-cabf3a283609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.409077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8c5d6-cd17-493d-b47b-cabf3a283609 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.409419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8c5d6-cd17-493d-b47b-cabf3a283609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.409751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8c5d6-cd17-493d-b47b-cabf3a283609 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.410541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8c5d6-cd17-493d-b47b-cabf3a283609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.413695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8c5d6-cd17-493d-b47b-cabf3a283609 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.434641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 816/1620] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:09.436095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8bd20-2bb3-457b-8fdf-2925df7282c9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.436729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8bd20-2bb3-457b-8fdf-2925df7282c9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.437018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8bd20-2bb3-457b-8fdf-2925df7282c9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.438384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 817/1621] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 19:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:09.444561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8bd20-2bb3-457b-8fdf-2925df7282c9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.471361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.472192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.472615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.472987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.491607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.493940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.507455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 805/1622] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:09.508819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.520114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424de0b-da0b-48eb-a0f8-e5bf64a1bcc3 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.522764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8bd20-2bb3-457b-8fdf-2925df7282c9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.525602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff0f53-45d5-4f27-9498-24f746c968a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.526391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff0f53-45d5-4f27-9498-24f746c968a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.526774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff0f53-45d5-4f27-9498-24f746c968a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.527179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff0f53-45d5-4f27-9498-24f746c968a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.528165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff0f53-45d5-4f27-9498-24f746c968a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.528617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.529325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.530175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.530462 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.530939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff0f53-45d5-4f27-9498-24f746c968a0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.545573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.547623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.563502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 818/1623] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:09.564499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.571808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 806/1624] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:09 2022] POST /identity/v3/users => generated 297 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:09.571808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421fba7-59aa-4119-813f-abd2014fb3fc None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.572087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421fba7-59aa-4119-813f-abd2014fb3fc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.573755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421fba7-59aa-4119-813f-abd2014fb3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.577199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0120a-aef8-4b10-bb08-bf52536263a8 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.583971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.587188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.587927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.588209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] PATH_INFO: `/v3/projects/baa7a7170ae54c71a2da5383ee783d89/users/103d8b2eca3c40dcb7216982fa2e8a25/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.606940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7421fba7-59aa-4119-813f-abd2014fb3fc None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:09.609138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7421fba7-59aa-4119-813f-abd2014fb3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:09.614769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa7a7170ae54c71a2da5383ee783d89, user_id=103d8b2eca3c40dcb7216982fa2e8a25, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.618743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.642447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 819/1625] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:09 2022] PUT /identity/v3/projects/baa7a7170ae54c71a2da5383ee783d89/users/103d8b2eca3c40dcb7216982fa2e8a25/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:09.646674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.787293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebc017-53b6-4ad7-8754-37933fc28c7a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.789658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 807/1626] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:09.790575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421fba7-59aa-4119-813f-abd2014fb3fc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.801131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.802130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.802641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.803014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.803873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.805630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.806914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421fba7-59aa-4119-813f-abd2014fb3fc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.813832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167d415-08df-4ac6-bd2a-4d8125114991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.814909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d415-08df-4ac6-bd2a-4d8125114991 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.815568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d415-08df-4ac6-bd2a-4d8125114991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.815911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d415-08df-4ac6-bd2a-4d8125114991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.817324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167d415-08df-4ac6-bd2a-4d8125114991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.819218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167d415-08df-4ac6-bd2a-4d8125114991 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.831150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 820/1627] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:09.833212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.853881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 808/1628] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:09.862431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69839-167c-45e6-973b-c689c8337e55 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.863627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69839-167c-45e6-973b-c689c8337e55 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.863906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69839-167c-45e6-973b-c689c8337e55 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.884256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 809/1629] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 19:06:09 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:09.885071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa69839-167c-45e6-973b-c689c8337e55 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.904854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa69839-167c-45e6-973b-c689c8337e55 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.911299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:09.912208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:09.912486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:09.912763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] PATH_INFO: `/v3/projects/f8d58e3ba3e14007b9207a8d4dc2b55c/users/a7e3a2a66a4c4d96ae1b4a52563378ca/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:09.947897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d58e3ba3e14007b9207a8d4dc2b55c, user_id=a7e3a2a66a4c4d96ae1b4a52563378ca, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:09.953129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:09.976340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa63da-66a4-42c3-b5a0-36e0e92a270f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:09.979439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 810/1630] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:09 2022] PUT /identity/v3/projects/f8d58e3ba3e14007b9207a8d4dc2b55c/users/a7e3a2a66a4c4d96ae1b4a52563378ca/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:09.983586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:10.073922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.075276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.075935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.076645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.093848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101582d8-dfa7-4ba6-9e22-c5674dbdc306 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:10.100272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe311e3-02e3-4210-988a-953eedcc28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.101556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe311e3-02e3-4210-988a-953eedcc28b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.102294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe311e3-02e3-4210-988a-953eedcc28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.102581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe311e3-02e3-4210-988a-953eedcc28b1 admin admin] PATH_INFO: `/v3/projects/baa7a7170ae54c71a2da5383ee783d89/users/103d8b2eca3c40dcb7216982fa2e8a25/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.109197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe311e3-02e3-4210-988a-953eedcc28b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa7a7170ae54c71a2da5383ee783d89, user_id=103d8b2eca3c40dcb7216982fa2e8a25, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.112306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe311e3-02e3-4210-988a-953eedcc28b1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.127612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 811/1631] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:09 2022] PUT /identity/v3/projects/baa7a7170ae54c71a2da5383ee783d89/users/103d8b2eca3c40dcb7216982fa2e8a25/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:10.130366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2080-fcce-42b3-85bb-06b945e20e27 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.130625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2080-fcce-42b3-85bb-06b945e20e27 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.131804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2080-fcce-42b3-85bb-06b945e20e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.159405 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-33bb2080-fcce-42b3-85bb-06b945e20e27 None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:10.160763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-33bb2080-fcce-42b3-85bb-06b945e20e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:10.174258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.176173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.201930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 821/1632] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:10.203777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:10.218543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124924a-e807-49e9-bf57-49a54e6b4cbc service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:10.271895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 812/1633] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:10.274078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817dbad-bf42-4f28-a253-dc17b13b9a9c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.274481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817dbad-bf42-4f28-a253-dc17b13b9a9c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.274861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817dbad-bf42-4f28-a253-dc17b13b9a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.296106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.296919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.297262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.298045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.298875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.300807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.318418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 822/1634] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:10.318418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:10.332948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1817dbad-bf42-4f28-a253-dc17b13b9a9c None None] MFA Rules not processed for user `103d8b2eca3c40dcb7216982fa2e8a25`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:10.334886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1817dbad-bf42-4f28-a253-dc17b13b9a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:10.437607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb4fd6-cd9a-40b4-b92e-f199185f8c35 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:10.447789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.448479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.449368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.449759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.460652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 813/1635] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:10.460652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817dbad-bf42-4f28-a253-dc17b13b9a9c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:10.474199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817dbad-bf42-4f28-a253-dc17b13b9a9c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:10.480433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.482750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.500595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3e7d-6c73-4251-88b2-07700d035353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.501819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3e7d-6c73-4251-88b2-07700d035353 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.502189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3e7d-6c73-4251-88b2-07700d035353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.502593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3e7d-6c73-4251-88b2-07700d035353 admin admin] PATH_INFO: `/v3/projects/f8d58e3ba3e14007b9207a8d4dc2b55c/users/a7e3a2a66a4c4d96ae1b4a52563378ca/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.509280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3e7d-6c73-4251-88b2-07700d035353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d58e3ba3e14007b9207a8d4dc2b55c, user_id=a7e3a2a66a4c4d96ae1b4a52563378ca, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.511676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 823/1636] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:10.515222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:10.522853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3e7d-6c73-4251-88b2-07700d035353 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.535092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8261-b159-4f16-96fe-d92680aa1251 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:10.555288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 814/1637] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:10 2022] PUT /identity/v3/projects/f8d58e3ba3e14007b9207a8d4dc2b55c/users/a7e3a2a66a4c4d96ae1b4a52563378ca/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:10.561523 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996288a-76e2-4816-bdae-6374a72b3e7a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.562077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996288a-76e2-4816-bdae-6374a72b3e7a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.563861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996288a-76e2-4816-bdae-6374a72b3e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.606376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f996288a-76e2-4816-bdae-6374a72b3e7a None None] MFA Rules not processed for user `a7e3a2a66a4c4d96ae1b4a52563378ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:10.608529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f996288a-76e2-4816-bdae-6374a72b3e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:10.652404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.653130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.653448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.654265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.760810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 815/1638] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:10.763117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2256951-952d-4a7f-a741-3bebe3942f81 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.763698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2256951-952d-4a7f-a741-3bebe3942f81 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.764070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2256951-952d-4a7f-a741-3bebe3942f81 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.765908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 816/1639] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 19:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:10.772788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a3016-1d4d-40ab-a800-32fe1e479394 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.773191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a3016-1d4d-40ab-a800-32fe1e479394 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.773629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a3016-1d4d-40ab-a800-32fe1e479394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.799139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.803213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.825543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-462a3016-1d4d-40ab-a800-32fe1e479394 None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:10.826908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-462a3016-1d4d-40ab-a800-32fe1e479394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:10.828082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 824/1640] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:10.991121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:11.017900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1d8a6-4d3b-424b-ba92-a26b7cb9d306 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:11.025288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:11.026374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:11.026940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:11.027487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:11.042154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 817/1641] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:11.053168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:11.055103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:11.075242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 825/1642] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:11.147764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a3016-1d4d-40ab-a800-32fe1e479394 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:11.159948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a3016-1d4d-40ab-a800-32fe1e479394 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:11.170578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38afa-3638-4d73-b487-27e4b30955a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:11.171248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38afa-3638-4d73-b487-27e4b30955a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:11.171527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38afa-3638-4d73-b487-27e4b30955a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:11.171799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38afa-3638-4d73-b487-27e4b30955a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:11.349619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38afa-3638-4d73-b487-27e4b30955a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:11.354377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38afa-3638-4d73-b487-27e4b30955a8 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:11.386162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 818/1643] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:11.638779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:11.648887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0adfac-9abf-463a-992f-aa5315070a5f service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:11.668556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:11.675290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:11.675647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:11.680210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:11.723241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:11.727630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:11.761750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 826/1644] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:11.980574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664d29-2963-4077-aef0-aceb9aa47e0d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:11.981307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664d29-2963-4077-aef0-aceb9aa47e0d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:11.981307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664d29-2963-4077-aef0-aceb9aa47e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:12.044956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-28664d29-2963-4077-aef0-aceb9aa47e0d None None] MFA Rules not processed for user `719edb67e8ae41b885581ae3645dd85b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:12.046204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-28664d29-2963-4077-aef0-aceb9aa47e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:12.052922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:12.063316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28a343-206b-46f1-83a2-e5b9a9b2552c service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:12.070137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:12.070795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:12.071079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:12.072350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:12.205727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:12.207861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:12.220688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 819/1645] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:12.222409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867b8ce-4fba-4d6b-934c-575add9e8dc8 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:12.222703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867b8ce-4fba-4d6b-934c-575add9e8dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:12.223010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867b8ce-4fba-4d6b-934c-575add9e8dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:12.228177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 827/1646] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:12.320242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9867b8ce-4fba-4d6b-934c-575add9e8dc8 None None] MFA Rules not processed for user `719edb67e8ae41b885581ae3645dd85b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:12.323156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9867b8ce-4fba-4d6b-934c-575add9e8dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:12.361115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 820/1647] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:12.362714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:12.377541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867b8ce-4fba-4d6b-934c-575add9e8dc8 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:12.444016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867b8ce-4fba-4d6b-934c-575add9e8dc8 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:12.451740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407016c8-97ff-462b-b605-5ad291007d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:12.452745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407016c8-97ff-462b-b605-5ad291007d1a service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:12.453440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407016c8-97ff-462b-b605-5ad291007d1a service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:12.453988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407016c8-97ff-462b-b605-5ad291007d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:12.466463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407016c8-97ff-462b-b605-5ad291007d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:12.468441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407016c8-97ff-462b-b605-5ad291007d1a service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:12.482952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 821/1648] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:12.618155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e00f5-4dfd-40a0-983a-ac56ab2f921f service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:12.647435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:12.649551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:12.651000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:12.651341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] PATH_INFO: `/v3/users/03223ed29ae84d7da0257be569be0319` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:12.656691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03223ed29ae84d7da0257be569be0319)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:12.661087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:06:12.661087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 04 19:06:12.661087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: May 04 19:06:12.670969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:12.782805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03223ed29ae84d7da0257be569be0319'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:12.794534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03223ed29ae84d7da0257be569be0319'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:12.795549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03223ed29ae84d7da0257be569be0319'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:12.797446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03223ed29ae84d7da0257be569be0319'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:12.812035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03223ed29ae84d7da0257be569be0319'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:12.848390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 828/1649] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:12 2022] DELETE /identity/v3/users/03223ed29ae84d7da0257be569be0319 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:12.851302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcecdb-8be7-4e85-9887-412ac6820a2c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:12.851575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcecdb-8be7-4e85-9887-412ac6820a2c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:12.851854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcecdb-8be7-4e85-9887-412ac6820a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:12.881175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6ebcecdb-8be7-4e85-9887-412ac6820a2c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:12.882415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6ebcecdb-8be7-4e85-9887-412ac6820a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:12.983925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 822/1650] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:12.996336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:12.998562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:13.099522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710275-1649-4892-b74c-3d7fbbe155f5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:13.104314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1164af-a574-4281-a18c-cb930ea1c722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:13.106161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1164af-a574-4281-a18c-cb930ea1c722 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:13.106790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1164af-a574-4281-a18c-cb930ea1c722 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:13.107142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1164af-a574-4281-a18c-cb930ea1c722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:13.121424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1164af-a574-4281-a18c-cb930ea1c722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:13.123119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1164af-a574-4281-a18c-cb930ea1c722 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:13.139778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 829/1651] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:13.150047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cc796-7b69-4ae8-86c2-9760414c6b72 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:13.150360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cc796-7b69-4ae8-86c2-9760414c6b72 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:13.150636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cc796-7b69-4ae8-86c2-9760414c6b72 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:13.154351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 823/1652] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 19:06:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:13.161609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:13.161906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:13.162192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:13.209639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] MFA Rules not processed for user `39f773f90b8c47608040ee24866242f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:13.212015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:13.221434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 830/1653] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:06:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:13.288495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cc796-7b69-4ae8-86c2-9760414c6b72 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:13.312642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cc796-7b69-4ae8-86c2-9760414c6b72 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:13.321883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a20a0-a475-4018-8ccf-5158cb303123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:13.334385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a20a0-a475-4018-8ccf-5158cb303123 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:13.334721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a20a0-a475-4018-8ccf-5158cb303123 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:13.335017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a20a0-a475-4018-8ccf-5158cb303123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:13.358676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a20a0-a475-4018-8ccf-5158cb303123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:13.360185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a20a0-a475-4018-8ccf-5158cb303123 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:13.380404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 824/1654] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:14.417328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:14.419802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:14.483172 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5456-685f-4fbc-aa19-ae624a57cf9d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:14.518544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:14.521699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:14.521983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:14.534560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] PATH_INFO: `/v3/projects/22cd825d7a4e4635bcff6fe0a5940c69` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:14.537439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cd825d7a4e4635bcff6fe0a5940c69)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:14.559607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:14.745487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cd825d7a4e4635bcff6fe0a5940c69', 'request_id': 'req-c94042c0-9498-4a32-9298-6e728f725ee4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:14.786385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cd825d7a4e4635bcff6fe0a5940c69', 'request_id': 'req-c94042c0-9498-4a32-9298-6e728f725ee4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:14.814768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cd825d7a4e4635bcff6fe0a5940c69', 'request_id': 'req-c94042c0-9498-4a32-9298-6e728f725ee4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:14.870621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] The token cache is being invalidate because project 22cd825d7a4e4635bcff6fe0a5940c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:14.870621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:14.880256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:14.885584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 831/1655] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:14 2022] DELETE /identity/v3/projects/22cd825d7a4e4635bcff6fe0a5940c69 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:14.887845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c20b-f6fb-447e-b449-68980a0d29a9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:14.888355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c20b-f6fb-447e-b449-68980a0d29a9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:14.888655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c20b-f6fb-447e-b449-68980a0d29a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:14.935656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4226c20b-f6fb-447e-b449-68980a0d29a9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:14.939384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:14.941242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:14.949256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4226c20b-f6fb-447e-b449-68980a0d29a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:15.110080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94042c0-9498-4a32-9298-6e728f725ee4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:15.119568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:15.121423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.121910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.122339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] PATH_INFO: `/v3/users/e248b49b03e54c4ea96cace68c44f3b3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.124397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e248b49b03e54c4ea96cace68c44f3b3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:15.128140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 825/1656] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:15.129205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:15.129514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec6af-7b8f-42a7-bf88-cb833588eeb5 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.129802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec6af-7b8f-42a7-bf88-cb833588eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.130069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec6af-7b8f-42a7-bf88-cb833588eeb5 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.135270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 826/1657] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 19:06:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:15.137111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96222-4ec3-4093-a26d-af83ae9d1692 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.137388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96222-4ec3-4093-a26d-af83ae9d1692 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.137683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96222-4ec3-4093-a26d-af83ae9d1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.184066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-62f96222-4ec3-4093-a26d-af83ae9d1692 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:15.185270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-62f96222-4ec3-4093-a26d-af83ae9d1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:15.220355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 827/1658] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:15.221903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47aa5-b10b-4df6-a194-0851bf528def None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.222326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47aa5-b10b-4df6-a194-0851bf528def None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.232324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47aa5-b10b-4df6-a194-0851bf528def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.255782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e248b49b03e54c4ea96cace68c44f3b3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:15.264754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-92c47aa5-b10b-4df6-a194-0851bf528def None None] MFA Rules not processed for user `4eba1582c17e4df991452d433cbe567b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:15.265996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-92c47aa5-b10b-4df6-a194-0851bf528def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:15.275885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e248b49b03e54c4ea96cace68c44f3b3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:15.277358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e248b49b03e54c4ea96cace68c44f3b3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:15.279600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e248b49b03e54c4ea96cace68c44f3b3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:15.302504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e248b49b03e54c4ea96cace68c44f3b3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:15.335573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 832/1659] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:14 2022] DELETE /identity/v3/users/e248b49b03e54c4ea96cace68c44f3b3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:15.338618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:15.340671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:15.347205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 828/1660] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 19:06:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:15.355799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26fa3c-1138-4466-b59e-dc9142026cc5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.356038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26fa3c-1138-4466-b59e-dc9142026cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.356421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26fa3c-1138-4466-b59e-dc9142026cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.394534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1f26fa3c-1138-4466-b59e-dc9142026cc5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:15.397140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1f26fa3c-1138-4466-b59e-dc9142026cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:15.499952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a4e46-0d5a-48b4-88e7-61c9b4ca71c6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:15.507077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:15.508505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.509036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.509571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.510627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:15.511181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:15.550109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:15.581634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 833/1661] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:15.585232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:15.644528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 829/1662] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:15.644528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26fa3c-1138-4466-b59e-dc9142026cc5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:15.667174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26fa3c-1138-4466-b59e-dc9142026cc5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:15.678031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:15.679136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.680820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.681249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.682889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:15.690128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:15.773712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 830/1663] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:15 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:15.778115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:15.780897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be966fd-5d92-485a-9af6-579a11cd55b6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:15.967664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da34d5-014c-4c05-940d-54bc13ff5454 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:15.989284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:15.990017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:15.990454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:15.990736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:15.991572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:15.996630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:16.015540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:16.018834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:16.019149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:16.019470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:16.029241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:16.048177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 831/1664] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:15 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:16.050054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:16.060465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:16.081552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:16.089882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:16.133795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 834/1665] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:16.157689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:16.202850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab156b48-7dbf-4ca8-ab4e-4adf5ca0131d service placement] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:16.235543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:16.236046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:16.236330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:16.236716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:16.240855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:16.242191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:16.266054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 835/1666] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:16.271272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:16.283049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b9e06-c268-48a9-9b15-d8f44a090d52 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:16.296361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeeff8-b3e9-4a94-98fa-22c70d16cfe3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:16.306728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42c09a-dafc-4e3a-996d-af4103aeea9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:16.307989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:16.308673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:16.308779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c09a-dafc-4e3a-996d-af4103aeea9d service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:16.308951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:16.309225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:16.309667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c09a-dafc-4e3a-996d-af4103aeea9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:16.309972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:16.317843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:16.318355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c09a-dafc-4e3a-996d-af4103aeea9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:16.341831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 836/1667] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:16.342771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:16.346342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42c09a-dafc-4e3a-996d-af4103aeea9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:16.349306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42c09a-dafc-4e3a-996d-af4103aeea9d service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:16.364299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470674e-ebe1-4216-827f-2d3d2717cfab admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:16.379585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:16.380509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:16.380786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:16.381055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] PATH_INFO: `/v3/projects/08e05a60807c4fd18ff49fa72bdfbc90/users/c1892fc41e5c4155b4d8ece03b534b2c/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:16.395535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 832/1668] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:16.416676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e05a60807c4fd18ff49fa72bdfbc90, user_id=c1892fc41e5c4155b4d8ece03b534b2c, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:16.424165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:16.452418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 837/1669] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:16 2022] PUT /identity/v3/projects/08e05a60807c4fd18ff49fa72bdfbc90/users/c1892fc41e5c4155b4d8ece03b534b2c/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:16.465147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3c25-6c64-4a32-a263-b2e05f3eb4e9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:16.465147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3c25-6c64-4a32-a263-b2e05f3eb4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:16.465147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3c25-6c64-4a32-a263-b2e05f3eb4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:16.558373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2d0b3c25-6c64-4a32-a263-b2e05f3eb4e9 None None] MFA Rules not processed for user `c1892fc41e5c4155b4d8ece03b534b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:16.562412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2d0b3c25-6c64-4a32-a263-b2e05f3eb4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:16.797843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:16.799644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:16.807037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 833/1670] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:16.812046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3c25-6c64-4a32-a263-b2e05f3eb4e9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:16.966486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3c25-6c64-4a32-a263-b2e05f3eb4e9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:16.987736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:16.988416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:16.988690 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:16.991731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:16.994136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa837ed9-d094-483a-a376-ec6fa1caeb41 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:16.995030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.000514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.019304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:17.020449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.022641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.022777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] PATH_INFO: `/v3/users/e865228290de44c98673461df2b9333d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.033421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e865228290de44c98673461df2b9333d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.035456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.080635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 834/1671] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:16 2022] POST /identity/v3/projects => generated 363 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:17.081844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:17.148925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e865228290de44c98673461df2b9333d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:17.168047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989004f-4445-44ee-ad37-0957a489936d admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:17.171090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e865228290de44c98673461df2b9333d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:17.171889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e865228290de44c98673461df2b9333d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:17.172689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e865228290de44c98673461df2b9333d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:17.179123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:17.180347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.180763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.181532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.182357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.184308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e6093752-9a3a-4869-ad44-cdf2d879f851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e865228290de44c98673461df2b9333d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:17.187971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.207560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 838/1672] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:16 2022] DELETE /identity/v3/users/e865228290de44c98673461df2b9333d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:17.210202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1559-3e63-4c5c-97df-cc08b3fc0e59 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.211498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1559-3e63-4c5c-97df-cc08b3fc0e59 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.212134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1559-3e63-4c5c-97df-cc08b3fc0e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.225962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 835/1673] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:17 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:17.230884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:17.232892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:17.248529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7ef63-03c1-4e8a-b887-11b4df3700b5 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:17.249482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b0ab1559-3e63-4c5c-97df-cc08b3fc0e59 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:17.253495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b0ab1559-3e63-4c5c-97df-cc08b3fc0e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:17.340601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:17.341724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.342426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.342981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.345066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.346892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.394996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 836/1674] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:17.396074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:17.408438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276294f3-56ef-4ab6-8271-34bf2eba6a6a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:17.412825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 839/1675] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:17.421804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:17.423393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.423674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.423951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] PATH_INFO: `/v3/projects/5ca105658530437d8c2a9679e9242d83/users/6ccea3b999214989b03cdaa0ffb5169a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.449369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca105658530437d8c2a9679e9242d83, user_id=6ccea3b999214989b03cdaa0ffb5169a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.453142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.487113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 837/1676] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:17 2022] PUT /identity/v3/projects/5ca105658530437d8c2a9679e9242d83/users/6ccea3b999214989b03cdaa0ffb5169a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:17.488373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab1559-3e63-4c5c-97df-cc08b3fc0e59 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:17.499293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab1559-3e63-4c5c-97df-cc08b3fc0e59 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:17.539093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:17.541771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:17.701497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878310f-c562-4b2e-96f2-4b268c4e0b07 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:17.704723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:17.705425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.705823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.706099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.711539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.715436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a7dc-1a66-4e4e-afe9-6d75ee7a3b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:17.716117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a7dc-1a66-4e4e-afe9-6d75ee7a3b2e service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.716476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a7dc-1a66-4e4e-afe9-6d75ee7a3b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.716755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a7dc-1a66-4e4e-afe9-6d75ee7a3b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.722609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.745097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8a7dc-1a66-4e4e-afe9-6d75ee7a3b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.746516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8a7dc-1a66-4e4e-afe9-6d75ee7a3b2e service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.772451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 840/1677] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:06:17.777479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:17.792002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 838/1678] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:17.817002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56333b-83de-43f1-abde-04734a21f8e6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:17.833430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:17.834392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.834915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.835209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] PATH_INFO: `/v3/projects/5ca105658530437d8c2a9679e9242d83/users/6ccea3b999214989b03cdaa0ffb5169a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.838091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca105658530437d8c2a9679e9242d83, user_id=6ccea3b999214989b03cdaa0ffb5169a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:17.842729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:17.861018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 841/1679] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:17 2022] PUT /identity/v3/projects/5ca105658530437d8c2a9679e9242d83/users/6ccea3b999214989b03cdaa0ffb5169a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:17.873794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:17.874047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:17.874372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:17.954153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] MFA Rules not processed for user `6ccea3b999214989b03cdaa0ffb5169a`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:17.955658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:18.118318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 839/1680] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:18.150442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:18.152913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:18.268224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16cb07-8262-4269-b4f7-3d066bd0069e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:18.276425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b124b62-df5d-4d72-9b4a-eb971e140e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:18.278931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b124b62-df5d-4d72-9b4a-eb971e140e1b service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:18.280015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b124b62-df5d-4d72-9b4a-eb971e140e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:18.280506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b124b62-df5d-4d72-9b4a-eb971e140e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:18.298467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b124b62-df5d-4d72-9b4a-eb971e140e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:18.300318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b124b62-df5d-4d72-9b4a-eb971e140e1b service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:18.334985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 842/1681] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:18.511233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:18.513338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:18.703447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf9c0-4721-43b6-b514-85c5195515fe None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:18.709542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:18.710640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:18.711063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:18.712443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] PATH_INFO: `/v3/projects/1bc7de2c2f1d4e9c88b45b11a315c7a4` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:18.713928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc7de2c2f1d4e9c88b45b11a315c7a4)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:18.715459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: WARNING py.warnings [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 19:06:18.715459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: warnings.warn(msg) May 04 19:06:18.715459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: May 04 19:06:18.717135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:18.856320 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc7de2c2f1d4e9c88b45b11a315c7a4', 'request_id': 'req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:18.883182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc7de2c2f1d4e9c88b45b11a315c7a4', 'request_id': 'req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:18.894991 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc7de2c2f1d4e9c88b45b11a315c7a4', 'request_id': 'req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:18.958709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] The token cache is being invalidate because project 1bc7de2c2f1d4e9c88b45b11a315c7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:18.959198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:18.960040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d5f98e4f-3bfa-4d5d-a529-39f902164b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:18.966252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 840/1682] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:18 2022] DELETE /identity/v3/projects/1bc7de2c2f1d4e9c88b45b11a315c7a4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:18.971617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:18.972128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:18.972420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.029409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:19.031445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:19.201382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 843/1683] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:19.209947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eac81-b37f-4e9e-8f7e-201e60ff4685 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:19.210530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eac81-b37f-4e9e-8f7e-201e60ff4685 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:19.210530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eac81-b37f-4e9e-8f7e-201e60ff4685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.291152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-766eac81-b37f-4e9e-8f7e-201e60ff4685 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:19.292467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-766eac81-b37f-4e9e-8f7e-201e60ff4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:19.331215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:19.333873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:19.347912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 841/1684] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:19.349584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766eac81-b37f-4e9e-8f7e-201e60ff4685 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:19.355222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405068-1ac9-42b3-bfbe-4f8d5a480296 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:19.369279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:19.370896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:19.371377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:19.371870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] PATH_INFO: `/v3/users/c1892fc41e5c4155b4d8ece03b534b2c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.376867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1892fc41e5c4155b4d8ece03b534b2c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:19.380388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:19.397080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766eac81-b37f-4e9e-8f7e-201e60ff4685 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:19.413207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b37046-9f47-4e70-9b11-8df28808de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:19.413950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37046-9f47-4e70-9b11-8df28808de93 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:19.414558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37046-9f47-4e70-9b11-8df28808de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:19.414558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37046-9f47-4e70-9b11-8df28808de93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.416132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b37046-9f47-4e70-9b11-8df28808de93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:19.416132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b37046-9f47-4e70-9b11-8df28808de93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:19.417147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b37046-9f47-4e70-9b11-8df28808de93 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:19.444337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 842/1685] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:19.445720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:19.446011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:19.446288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.498165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] MFA Rules not processed for user `047fb46d1a764838bd8f8a44609a2e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:19.499827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:19.516448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1892fc41e5c4155b4d8ece03b534b2c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.537684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1892fc41e5c4155b4d8ece03b534b2c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.544260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1892fc41e5c4155b4d8ece03b534b2c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.544704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1892fc41e5c4155b4d8ece03b534b2c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.569329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1892fc41e5c4155b4d8ece03b534b2c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.612556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 844/1686] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:19 2022] DELETE /identity/v3/users/c1892fc41e5c4155b4d8ece03b534b2c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:19.613247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:19.614700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:19.630705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 843/1687] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:19.631717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:19.633498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:19.663225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d82b5b-bd7c-4b9a-9aa1-b1232204fb10 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:19.745770 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242047-d5f1-4c9a-95ab-c67e8197795f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:19.754267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:19.755970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:19.756700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:19.757085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] PATH_INFO: `/v3/projects/8d4b1ea121aa45c6974feb10b0e1d5ac` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.759459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4b1ea121aa45c6974feb10b0e1d5ac)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:19.763048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:19.783382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b9d4f-181a-4581-b656-daea99b9d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:19.784066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9d4f-181a-4581-b656-daea99b9d41b admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:19.784351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9d4f-181a-4581-b656-daea99b9d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:19.784624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9d4f-181a-4581-b656-daea99b9d41b admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.785314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b9d4f-181a-4581-b656-daea99b9d41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:19.787276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b9d4f-181a-4581-b656-daea99b9d41b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:19.840220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4b1ea121aa45c6974feb10b0e1d5ac', 'request_id': 'req-a0c8fcd0-6775-426e-805e-434e0788f9ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.840584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 844/1688] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:19 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:19.842220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:19.844590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:19.844999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:19.848004 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4b1ea121aa45c6974feb10b0e1d5ac', 'request_id': 'req-a0c8fcd0-6775-426e-805e-434e0788f9ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.861274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4b1ea121aa45c6974feb10b0e1d5ac', 'request_id': 'req-a0c8fcd0-6775-426e-805e-434e0788f9ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.884724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] The token cache is being invalidate because project 8d4b1ea121aa45c6974feb10b0e1d5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:19.884955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.885706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:19.886666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:19.889760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 845/1689] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:19 2022] DELETE /identity/v3/projects/8d4b1ea121aa45c6974feb10b0e1d5ac => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:19.893012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:19.893135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:19.893211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:20.054437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 845/1690] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:20.054437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:20.057584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:20.074866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fcd0-6775-426e-805e-434e0788f9ab admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:20.079631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376753-8576-4559-b2aa-bb1b48f03785 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:20.091584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:20.092501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.092914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.093340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.094816 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:20.097041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:20.140498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 846/1691] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:20 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:20.150472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:20.155478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:20.196281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac150d2b-f105-4181-8414-670d9374efb1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:20.209134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:20.211505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.214455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.215478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] PATH_INFO: `/v3/users/103d8b2eca3c40dcb7216982fa2e8a25` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.217260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103d8b2eca3c40dcb7216982fa2e8a25)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:20.219759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:20.242529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:20.244223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.244651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.245235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.247892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:20.324312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103d8b2eca3c40dcb7216982fa2e8a25'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:20.342770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103d8b2eca3c40dcb7216982fa2e8a25'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:20.343610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103d8b2eca3c40dcb7216982fa2e8a25'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:20.348094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:20.350185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:20.362994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103d8b2eca3c40dcb7216982fa2e8a25'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:20.363715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103d8b2eca3c40dcb7216982fa2e8a25'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:20.366161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 846/1692] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:20.367340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:20.379332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ad640-0590-4576-9296-c9571ecd49ad service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:20.384909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:20.386077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.386810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.387224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.388104 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:20.389971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:20.405914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 847/1694] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:20.407517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:20.409532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:20.410194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 847/1694] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:20 2022] DELETE /identity/v3/users/103d8b2eca3c40dcb7216982fa2e8a25 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:20.416480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:20.421041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:20.498434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae93ce-7e47-42fd-be13-dae70f4c1e9c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:20.590962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865296f-1db7-4293-a8bf-d67e751b0505 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:20.596991 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:20.597832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.598065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.598375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.599149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:20.601615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:20.616963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 848/1695] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:20.622401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:20.644138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a33ef-2e73-4634-90b3-9d670fdb6617 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:20.655561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d2e96-6398-4c31-8685-994b2eda6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:20.656648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2e96-6398-4c31-8685-994b2eda6ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.657104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2e96-6398-4c31-8685-994b2eda6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.657713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2e96-6398-4c31-8685-994b2eda6ff6 admin admin] PATH_INFO: `/v3/projects/6d1e698ba9ce4c3198f8a41d29651084/users/605369f77b004370b6b98f10f704539c/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.694313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:20.694994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.695275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.695551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.700133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:20.702192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d2e96-6398-4c31-8685-994b2eda6ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1e698ba9ce4c3198f8a41d29651084, user_id=605369f77b004370b6b98f10f704539c, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:20.706019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d2e96-6398-4c31-8685-994b2eda6ff6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:20.722704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:20.725118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:20.736901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 849/1696] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:20 2022] PUT /identity/v3/projects/6d1e698ba9ce4c3198f8a41d29651084/users/605369f77b004370b6b98f10f704539c/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:20.746985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:20.747425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:20.748454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:20.763099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 848/1697] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:20.816231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] MFA Rules not processed for user `605369f77b004370b6b98f10f704539c`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:20.818634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:21.004243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 850/1698] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:21.019415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:21.022101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:21.152418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc453b-6d51-4dfa-8a84-839b7fa8d50b service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:21.298469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20396367-ac25-43e5-abda-51150cd6c6b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:21.301614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396367-ac25-43e5-abda-51150cd6c6b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:21.304230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396367-ac25-43e5-abda-51150cd6c6b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:21.305106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396367-ac25-43e5-abda-51150cd6c6b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:21.333709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20396367-ac25-43e5-abda-51150cd6c6b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:21.336520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20396367-ac25-43e5-abda-51150cd6c6b8 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:21.382068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:21.384424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:21.407540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 849/1699] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:21.578894 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60145a8a-9202-4d6c-a166-eb4553a61413 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:21.595955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:21.597577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:21.598117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:21.598492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] PATH_INFO: `/v3/projects/baa7a7170ae54c71a2da5383ee783d89` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:21.601526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa7a7170ae54c71a2da5383ee783d89)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:21.605996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:21.811584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa7a7170ae54c71a2da5383ee783d89', 'request_id': 'req-0f11a968-1584-497a-b2df-16be9ff63f55'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:21.832516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4db1c-87af-4c80-9bd3-94e6c69b219c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:21.836927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4db1c-87af-4c80-9bd3-94e6c69b219c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:21.842136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa7a7170ae54c71a2da5383ee783d89', 'request_id': 'req-0f11a968-1584-497a-b2df-16be9ff63f55'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:21.845817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4db1c-87af-4c80-9bd3-94e6c69b219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:21.864797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa7a7170ae54c71a2da5383ee783d89', 'request_id': 'req-0f11a968-1584-497a-b2df-16be9ff63f55'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:21.877267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-56b4db1c-87af-4c80-9bd3-94e6c69b219c None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:21.878555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-56b4db1c-87af-4c80-9bd3-94e6c69b219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:21.892397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] The token cache is being invalidate because project baa7a7170ae54c71a2da5383ee783d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:21.892944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:21.893698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0f11a968-1584-497a-b2df-16be9ff63f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:21.906467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 851/1700] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:21 2022] DELETE /identity/v3/projects/baa7a7170ae54c71a2da5383ee783d89 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:21.907974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71214a-db74-48e4-8cba-60148fe2d612 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:21.908298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71214a-db74-48e4-8cba-60148fe2d612 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:21.908608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71214a-db74-48e4-8cba-60148fe2d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:21.973939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5b71214a-db74-48e4-8cba-60148fe2d612 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:21.977223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5b71214a-db74-48e4-8cba-60148fe2d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:22.019394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 850/1701] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:22.211407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 852/1702] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:22.227960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e74e-8809-47a5-bd1d-a9cb8e95a981 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.228499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e74e-8809-47a5-bd1d-a9cb8e95a981 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.228499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e74e-8809-47a5-bd1d-a9cb8e95a981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.272753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4f27e74e-8809-47a5-bd1d-a9cb8e95a981 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:22.278986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4f27e74e-8809-47a5-bd1d-a9cb8e95a981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:22.305351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 851/1703] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:22.310313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71214a-db74-48e4-8cba-60148fe2d612 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:22.334971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71214a-db74-48e4-8cba-60148fe2d612 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:22.359819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:22.361279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.363069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.365096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.369721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:22.372294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:22.374070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:22.419003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 853/1704] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:22.425135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27e74e-8809-47a5-bd1d-a9cb8e95a981 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:22.441416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27e74e-8809-47a5-bd1d-a9cb8e95a981 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:22.459011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:22.462906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.464692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.465209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.466228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:22.470782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:22.476942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:22.483030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:22.565287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 852/1705] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:22 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:22.566687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:22.660499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80dc4-7b39-4ee4-87ab-4e3708fbc2a1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:22.708316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c68c-8e6a-406c-819f-ebc285953077 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:22.724644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:22.726203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.726566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.726913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.727698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:22.736004 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:22.778579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 853/1706] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:22 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:22.780605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:22.799636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266455-e6f1-4c9a-921f-a300ab34721c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:22.805457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:22.806483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.807454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:22.808689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.808776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.809049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.809240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.809912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:22.810312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.811745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:22.825755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 854/1707] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:22.831480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:22.845245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d527017-16e8-4124-9363-acbbaa45952a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:22.850670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:22.851445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.851828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.852735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.853931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:22.856386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:22.874097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 855/1708] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:06:22.878231 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:22.895335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060fbc-ef0e-453b-9a7f-cd64845e3480 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:22.911101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba411129-a7d5-4a4e-88b1-4d203ada3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:22.913681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba411129-a7d5-4a4e-88b1-4d203ada3afb admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:22.918325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba411129-a7d5-4a4e-88b1-4d203ada3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:22.918846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba411129-a7d5-4a4e-88b1-4d203ada3afb admin admin] PATH_INFO: `/v3/projects/0ce5c0e0d5374778a71349069aeef99d/users/915d722e8ecb4a5182b90568a33c2520/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:22.956395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba411129-a7d5-4a4e-88b1-4d203ada3afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce5c0e0d5374778a71349069aeef99d, user_id=915d722e8ecb4a5182b90568a33c2520, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:22.968122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba411129-a7d5-4a4e-88b1-4d203ada3afb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:23.017054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 856/1709] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:22 2022] PUT /identity/v3/projects/0ce5c0e0d5374778a71349069aeef99d/users/915d722e8ecb4a5182b90568a33c2520/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:23.019626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:23.020192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:23.020661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:23.027930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:23.030374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:23.043820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 854/1710] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:06:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:06:23.080682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] MFA Rules not processed for user `915d722e8ecb4a5182b90568a33c2520`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:23.082082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:23.299434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 857/1711] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:23.303904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:23.320593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0bf26-3705-462c-91e5-a71438d15c88 service swift] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:23.634876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:23.638146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:23.697529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:23.704850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:23.706613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:23.709773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:23.710841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:23.714696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:23.843171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 855/1712] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:23 2022] POST /identity/v3/projects => generated 381 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:23.855575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:23.983312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e8efd-fee4-4681-83a6-5e65a51fa2e5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:24.204490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11a68-2ec0-4cd8-9532-75ed8587ea84 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:24.226008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:24.226851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:24.227928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:24.228264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:24.230924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:24.234429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:24.255425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:24.257739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:24.258482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:24.258799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] PATH_INFO: `/v3/projects/08e05a60807c4fd18ff49fa72bdfbc90` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:24.264892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e05a60807c4fd18ff49fa72bdfbc90)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:24.268182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:24.289086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 856/1713] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:23 2022] POST /identity/v3/users => generated 297 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:24.291039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:24.316772 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f79a0-8a1d-45eb-a3a8-1009c8f73073 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:24.331596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:24.332372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:24.332658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:24.332931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:24.346214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:24.351340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:24.392110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 857/1714] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:24.395028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:24.431100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba890b7-2e4d-4674-b974-ebf260c26fa9 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:24.442858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:24.443850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:24.444150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:24.444419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] PATH_INFO: `/v3/projects/6045e93b579448f4a703c5f6ac0699fb/users/434275fbdd4640ceb2fe4a20807e2c15/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:24.492617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6045e93b579448f4a703c5f6ac0699fb, user_id=434275fbdd4640ceb2fe4a20807e2c15, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:24.501768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:24.591314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 858/1715] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:24 2022] PUT /identity/v3/projects/6045e93b579448f4a703c5f6ac0699fb/users/434275fbdd4640ceb2fe4a20807e2c15/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:24.613406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:24.873896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb1af-c25b-475a-a552-748af06b584a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:24.886765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e05a60807c4fd18ff49fa72bdfbc90', 'request_id': 'req-da1aee55-4f11-4129-b79c-2b2688d3fac9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:24.908453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e05a60807c4fd18ff49fa72bdfbc90', 'request_id': 'req-da1aee55-4f11-4129-b79c-2b2688d3fac9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:24.951415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e05a60807c4fd18ff49fa72bdfbc90', 'request_id': 'req-da1aee55-4f11-4129-b79c-2b2688d3fac9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:24.984900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] The token cache is being invalidate because project 08e05a60807c4fd18ff49fa72bdfbc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:24.985198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:24.991040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:24.993153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 858/1716] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:23 2022] DELETE /identity/v3/projects/08e05a60807c4fd18ff49fa72bdfbc90 => generated 0 bytes in 1359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:24.997625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:25.003576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:25.134638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:25.136196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:25.136758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:25.137297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:25.138364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:25.140246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:25.175339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 859/1717] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:25.177064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:25.185170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:25.218065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aee55-4f11-4129-b79c-2b2688d3fac9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:25.218953 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d0594-4f2c-4438-9477-c01b648ea93c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:25.238123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:25.239012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:25.239292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:25.239566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] PATH_INFO: `/v3/users/ddcf17661a994d11a7fe54d7fee9f206` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:25.239979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:25.241093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:25.241206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcf17661a994d11a7fe54d7fee9f206)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:25.241697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:25.242189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] PATH_INFO: `/v3/users/6ccea3b999214989b03cdaa0ffb5169a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:25.244222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccea3b999214989b03cdaa0ffb5169a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:25.246881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:25.248038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:25.389243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccea3b999214989b03cdaa0ffb5169a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.402866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccea3b999214989b03cdaa0ffb5169a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.403747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccea3b999214989b03cdaa0ffb5169a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.410442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcf17661a994d11a7fe54d7fee9f206'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.425836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccea3b999214989b03cdaa0ffb5169a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.426940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccea3b999214989b03cdaa0ffb5169a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.432746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcf17661a994d11a7fe54d7fee9f206'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.435370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcf17661a994d11a7fe54d7fee9f206'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.439203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcf17661a994d11a7fe54d7fee9f206'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.464736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 860/1718] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:25 2022] DELETE /identity/v3/users/6ccea3b999214989b03cdaa0ffb5169a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:25.466929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:25.468054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-416bdf36-01f0-46da-ae3c-90d88fe437e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcf17661a994d11a7fe54d7fee9f206'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:25.471881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:25.538735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 859/1719] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:24 2022] DELETE /identity/v3/users/ddcf17661a994d11a7fe54d7fee9f206 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:25.540974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:25.541320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:25.541710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:25.562808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:25.564150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:25.644749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 860/1720] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:25.676487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:25.678002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:25.692710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0c57-a77e-4e38-99ea-43fcad061324 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:25.709573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e452-9b9a-46a5-88b3-5dca86126dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:25.710687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e452-9b9a-46a5-88b3-5dca86126dea admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:25.711495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e452-9b9a-46a5-88b3-5dca86126dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:25.712063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e452-9b9a-46a5-88b3-5dca86126dea admin admin] PATH_INFO: `/v3/projects/6045e93b579448f4a703c5f6ac0699fb/users/434275fbdd4640ceb2fe4a20807e2c15/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:25.714909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759e452-9b9a-46a5-88b3-5dca86126dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6045e93b579448f4a703c5f6ac0699fb, user_id=434275fbdd4640ceb2fe4a20807e2c15, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:25.720609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759e452-9b9a-46a5-88b3-5dca86126dea admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:25.753195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 861/1721] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:25 2022] PUT /identity/v3/projects/6045e93b579448f4a703c5f6ac0699fb/users/434275fbdd4640ceb2fe4a20807e2c15/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:25.755527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460bee4-1167-47c2-bdf5-bad396772489 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:25.755812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460bee4-1167-47c2-bdf5-bad396772489 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:25.756087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460bee4-1167-47c2-bdf5-bad396772489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:25.796650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b460bee4-1167-47c2-bdf5-bad396772489 None None] MFA Rules not processed for user `434275fbdd4640ceb2fe4a20807e2c15`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:25.798154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b460bee4-1167-47c2-bdf5-bad396772489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:25.860697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e22a99-1a94-4edf-885f-3cf2a70e3379 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:26.113383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 862/1722] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:26.118826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:26.118938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:26.119211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:26.173126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:26.173844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:26.178129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:26.178448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:26.222479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] MFA Rules not processed for user `047fb46d1a764838bd8f8a44609a2e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:26.225901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:26.389280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:26.402152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:26.415377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 863/1723] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:26.418016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:26.423271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:26.430576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 861/1724] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:26.521971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1bab-adc0-4286-b066-786e54179b75 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:26.546428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:26.547099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:26.547375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:26.547645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:26.591841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:26.593310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:26.646034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 864/1725] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:26.835495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:26.860691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d7dd-d105-4521-8d66-766898e491a8 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:26.872734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad33731-056a-4c4f-a884-0c50c6642353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:26.873398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33731-056a-4c4f-a884-0c50c6642353 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:26.873705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33731-056a-4c4f-a884-0c50c6642353 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:26.874042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33731-056a-4c4f-a884-0c50c6642353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:26.890780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3ad33731-056a-4c4f-a884-0c50c6642353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:27.122675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad33731-056a-4c4f-a884-0c50c6642353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:27.124155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad33731-056a-4c4f-a884-0c50c6642353 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:27.164457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 862/1726] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:30.146634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:30.150429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:30.189114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b891-8a8b-4568-84ba-6d4c18774795 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:30.189699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b891-8a8b-4568-84ba-6d4c18774795 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:30.189785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b891-8a8b-4568-84ba-6d4c18774795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:30.210257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab62fad-f7fd-4cf6-9f3a-5de961992fe6 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:30.226679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:30.227671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:30.227826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:30.228101 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] PATH_INFO: `/v3/projects/815a238944ab430586d4b8b3ba13eafd` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:30.230324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815a238944ab430586d4b8b3ba13eafd)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:30.236158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:30.256594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2082b891-8a8b-4568-84ba-6d4c18774795 None None] MFA Rules not processed for user `47deb39e5d954424a4fb4e97375443f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:30.258555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2082b891-8a8b-4568-84ba-6d4c18774795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:30.442201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815a238944ab430586d4b8b3ba13eafd', 'request_id': 'req-66f8b589-4264-41a5-bb73-f13960d2b040'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.465836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815a238944ab430586d4b8b3ba13eafd', 'request_id': 'req-66f8b589-4264-41a5-bb73-f13960d2b040'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.477887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815a238944ab430586d4b8b3ba13eafd', 'request_id': 'req-66f8b589-4264-41a5-bb73-f13960d2b040'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.507961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] The token cache is being invalidate because project 815a238944ab430586d4b8b3ba13eafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:30.509044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.512029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.516919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 865/1727] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:30 2022] DELETE /identity/v3/projects/815a238944ab430586d4b8b3ba13eafd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:30.519057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:30.522868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:30.524261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 863/1728] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:30.525164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082b891-8a8b-4568-84ba-6d4c18774795 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:30.566493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082b891-8a8b-4568-84ba-6d4c18774795 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:30.732627 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b589-4264-41a5-bb73-f13960d2b040 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:30.750207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:30.751689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:30.752172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:30.752555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] PATH_INFO: `/v3/projects/5ca105658530437d8c2a9679e9242d83` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:30.754676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca105658530437d8c2a9679e9242d83)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:30.759259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:30.768725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:30.769647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:30.769933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:30.770205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] PATH_INFO: `/v3/users/a7e3a2a66a4c4d96ae1b4a52563378ca` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:30.773348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e3a2a66a4c4d96ae1b4a52563378ca)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:30.775299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:30.880113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e3a2a66a4c4d96ae1b4a52563378ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.894900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e3a2a66a4c4d96ae1b4a52563378ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.895549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e3a2a66a4c4d96ae1b4a52563378ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.896335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e3a2a66a4c4d96ae1b4a52563378ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.909929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5215e2dc-4c41-4ce3-a1ba-e328eb225647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e3a2a66a4c4d96ae1b4a52563378ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.914907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca105658530437d8c2a9679e9242d83', 'request_id': 'req-5fdef906-526c-4582-9221-23df40775d06'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.934977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca105658530437d8c2a9679e9242d83', 'request_id': 'req-5fdef906-526c-4582-9221-23df40775d06'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.955370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 864/1729] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:30 2022] DELETE /identity/v3/users/a7e3a2a66a4c4d96ae1b4a52563378ca => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:30.956712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8dd0e-26e5-46ab-a6e7-57dcad26e3c5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:30.957005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8dd0e-26e5-46ab-a6e7-57dcad26e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:30.957288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8dd0e-26e5-46ab-a6e7-57dcad26e3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:30.967210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca105658530437d8c2a9679e9242d83', 'request_id': 'req-5fdef906-526c-4582-9221-23df40775d06'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.993254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] The token cache is being invalidate because project 5ca105658530437d8c2a9679e9242d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:30.993635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.994286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:30.996224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 866/1730] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:30 2022] DELETE /identity/v3/projects/5ca105658530437d8c2a9679e9242d83 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:30.997034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:30.999429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.000424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e6a8dd0e-26e5-46ab-a6e7-57dcad26e3c5 None None] MFA Rules not processed for user `47deb39e5d954424a4fb4e97375443f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:31.001935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e6a8dd0e-26e5-46ab-a6e7-57dcad26e3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.160024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdef906-526c-4582-9221-23df40775d06 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:31.173496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 865/1731] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:31.175011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae955aa-c6f6-43ff-8181-f1e603bb0937 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:31.175302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae955aa-c6f6-43ff-8181-f1e603bb0937 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:31.175579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae955aa-c6f6-43ff-8181-f1e603bb0937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:31.267924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4ae955aa-c6f6-43ff-8181-f1e603bb0937 None None] MFA Rules not processed for user `d54ad9809c8241a18d88fa6cd960badd`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:31.269164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4ae955aa-c6f6-43ff-8181-f1e603bb0937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.314387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:31.315584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:31.316096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:31.316263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] PATH_INFO: `/v3/users/915d722e8ecb4a5182b90568a33c2520` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:31.318340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=915d722e8ecb4a5182b90568a33c2520)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:31.322741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:31.447688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915d722e8ecb4a5182b90568a33c2520'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:31.464075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915d722e8ecb4a5182b90568a33c2520'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:31.465292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915d722e8ecb4a5182b90568a33c2520'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:31.471363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 866/1732] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:31.475505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:31.476891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:31.477748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:31.480338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915d722e8ecb4a5182b90568a33c2520'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:31.481813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7c554ec0-957a-492f-89c3-fc9d9070af3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915d722e8ecb4a5182b90568a33c2520'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:31.509236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 867/1733] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:30 2022] DELETE /identity/v3/users/915d722e8ecb4a5182b90568a33c2520 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:31.512378 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d606d-f336-45c1-9d19-6f7af375b59d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:31.513817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d606d-f336-45c1-9d19-6f7af375b59d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:31.514427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d606d-f336-45c1-9d19-6f7af375b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:31.517358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] MFA Rules not processed for user `39f773f90b8c47608040ee24866242f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:31.518863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.559200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-883d606d-f336-45c1-9d19-6f7af375b59d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:31.562645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-883d606d-f336-45c1-9d19-6f7af375b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.640498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 867/1734] 10.222.0.11 () {58 vars in 1015 bytes} [Wed May 4 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:31.642732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:31.645570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.662891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 868/1735] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:31.662891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592a34-38fe-4840-a97e-3215efec1130 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:31.662891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592a34-38fe-4840-a97e-3215efec1130 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:31.662891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592a34-38fe-4840-a97e-3215efec1130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:31.749914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-50592a34-38fe-4840-a97e-3215efec1130 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:31.753297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-50592a34-38fe-4840-a97e-3215efec1130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.796102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 869/1736] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:31.800106 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:31.801539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:31.802163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:31.873856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:31.887909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.927761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 870/1737] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:31.930371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:31.936755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:31.958874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02609a3c-86b9-4558-bbd3-725a2e73bd0a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:31.987415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:31.988043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:31.988330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:31.988626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:31.993749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3b65-3986-4035-83eb-db1c4b3b263e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:32.004973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:32.021145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:32.021880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:32.022167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:32.022442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:32.031699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:32.225232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:32.227343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:32.259648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:32.261826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 868/1738] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:32.262910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:32.263698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:32.270940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:32.287071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 871/1739] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:32.289053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:32.293162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:32.295038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178fd27-959e-4e39-990a-0fd265bf8633 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:32.306277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:32.306955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:32.307899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:32.308195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:32.316366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d08359-21a4-4595-8e4b-6c8ada760bdb service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:32.342715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:32.343448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:32.343749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:32.344066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:32.346842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:32.348397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:32.375614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:32.377079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:32.390723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 869/1740] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:32.391607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:32.420869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 872/1741] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:32.421610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:32.427496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5f13-15a3-4987-8b35-d9adbbad17bd service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:32.429191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:32.444273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:32.444963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:32.445247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:32.445558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:32.446365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:32.446675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:32.448527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:32.480690 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0cf6-26ce-40b0-af79-11d972f07edc service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:32.501840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:32.502769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:32.503069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:32.503369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] PATH_INFO: `/v3/projects/f8d58e3ba3e14007b9207a8d4dc2b55c` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:32.506305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d58e3ba3e14007b9207a8d4dc2b55c)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:32.507788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 870/1742] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:32.509673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:32.513266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:32.539446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f32947-74bd-4191-824c-40a927393fa0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:32.565597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:32.566299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:32.569127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:32.569661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:32.571570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:32.584426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:32.674669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d58e3ba3e14007b9207a8d4dc2b55c', 'request_id': 'req-27f84df1-fd69-4fb9-a01c-5a69123d6def'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:32.700115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 871/1743] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:32 2022] POST /identity/v3/projects => generated 399 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:32.703244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d58e3ba3e14007b9207a8d4dc2b55c', 'request_id': 'req-27f84df1-fd69-4fb9-a01c-5a69123d6def'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:32.710566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:32.716850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d58e3ba3e14007b9207a8d4dc2b55c', 'request_id': 'req-27f84df1-fd69-4fb9-a01c-5a69123d6def'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:32.774968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] The token cache is being invalidate because project f8d58e3ba3e14007b9207a8d4dc2b55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:32.775257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:32.777877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-27f84df1-fd69-4fb9-a01c-5a69123d6def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:32.784871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 873/1744] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:32 2022] DELETE /identity/v3/projects/f8d58e3ba3e14007b9207a8d4dc2b55c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:32.790593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c32ab3-f8d5-4e24-a522-b811d050896c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:32.794243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c32ab3-f8d5-4e24-a522-b811d050896c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:32.794678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c32ab3-f8d5-4e24-a522-b811d050896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:32.844500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-71c32ab3-f8d5-4e24-a522-b811d050896c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:32.851070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-71c32ab3-f8d5-4e24-a522-b811d050896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:32.951811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64049b34-001d-4bfd-8c6b-95a0628b5ca0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:32.990518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:32.990768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.000038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.000038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.000038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.001763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.002922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 874/1745] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:33.006618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bc424-6e2e-49f0-bba0-d14e8918649e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.007082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bc424-6e2e-49f0-bba0-d14e8918649e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.008142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bc424-6e2e-49f0-bba0-d14e8918649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.079439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 872/1746] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:32 2022] POST /identity/v3/users => generated 300 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:33.087225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.096517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-220bc424-6e2e-49f0-bba0-d14e8918649e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:33.098149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:33.102843 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-220bc424-6e2e-49f0-bba0-d14e8918649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:33.171016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 875/1747] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:33.171223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af67e8f-4287-4d3f-a7e4-d835d2278a57 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.173649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bc424-6e2e-49f0-bba0-d14e8918649e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.180035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.180741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.181051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.181357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.182711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.184387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.194786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bc424-6e2e-49f0-bba0-d14e8918649e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.211095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.213636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.214027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.214759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.215510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:33.215828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.223907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.233879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 873/1748] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:33.235205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.266403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 876/1749] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:33.267630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.270051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595316a-5b98-4fdd-b8cf-b07968f24155 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.288454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.289291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.289616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.289896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.306285 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.310994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.315568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f21cf-ac08-48bf-9766-eefd55758c6c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.333038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.334229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.334600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.335062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.335832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.338129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.344173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 874/1750] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:33.348560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.369068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe63e3-1add-4f39-82d4-8c71e68267c0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.383327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc828-1de7-4e74-80c1-214a06b22023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.384310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc828-1de7-4e74-80c1-214a06b22023 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.384613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc828-1de7-4e74-80c1-214a06b22023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.384893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc828-1de7-4e74-80c1-214a06b22023 admin admin] PATH_INFO: `/v3/projects/125fb12dd2e84a1e9afab5d453926c02/users/2ec743a7794c40f5b204307be1d166d2/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.418299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 877/1751] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:33 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:33.422436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.438711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fc828-1de7-4e74-80c1-214a06b22023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125fb12dd2e84a1e9afab5d453926c02, user_id=2ec743a7794c40f5b204307be1d166d2, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.441806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fc828-1de7-4e74-80c1-214a06b22023 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.488289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 875/1752] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:33 2022] PUT /identity/v3/projects/125fb12dd2e84a1e9afab5d453926c02/users/2ec743a7794c40f5b204307be1d166d2/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:33.498609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08683-9278-469b-92f5-67a076126fc2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.498949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08683-9278-469b-92f5-67a076126fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.499297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08683-9278-469b-92f5-67a076126fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.591355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9ac08683-9278-469b-92f5-67a076126fc2 None None] MFA Rules not processed for user `2ec743a7794c40f5b204307be1d166d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:33.594544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9ac08683-9278-469b-92f5-67a076126fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:33.616194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec157f-0ca8-49bd-afbf-b54bf80da307 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.815772 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.816852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.816852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.817090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.818051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.821626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.866790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 876/1753] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:33.867873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac08683-9278-469b-92f5-67a076126fc2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.868493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 878/1754] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:33 2022] POST /identity/v3/users => generated 297 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:33.872725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.895666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758af038-0026-4e03-b10e-3cc717f67c8a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.904096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac08683-9278-469b-92f5-67a076126fc2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:33.913908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.917716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.917847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:33.918693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:33.918906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.919175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.919442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:33.919853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:33.919956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.921875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.923280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:33.925089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:33.958510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 879/1755] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:33.959893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:33.966312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:34.010489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688775-cae6-4916-98f4-415c4d44e591 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:34.031169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:34.033920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:34.034336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:34.034775 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 877/1756] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:33 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:34.036161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:34.036313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] PATH_INFO: `/v3/projects/0ce5c0e0d5374778a71349069aeef99d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:34.041812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce5c0e0d5374778a71349069aeef99d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:34.054443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:34.246252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce5c0e0d5374778a71349069aeef99d', 'request_id': 'req-bf6df630-77d1-4529-87b3-3f9dd8a50845'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.271462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce5c0e0d5374778a71349069aeef99d', 'request_id': 'req-bf6df630-77d1-4529-87b3-3f9dd8a50845'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.279876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cae73-6d31-438b-a128-2404a341ead1 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:34.293570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce5c0e0d5374778a71349069aeef99d', 'request_id': 'req-bf6df630-77d1-4529-87b3-3f9dd8a50845'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.331152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] The token cache is being invalidate because project 0ce5c0e0d5374778a71349069aeef99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:34.331455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.335842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.340802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 880/1757] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:33 2022] DELETE /identity/v3/projects/0ce5c0e0d5374778a71349069aeef99d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:34.340802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:34.341311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:34.440108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:34.441013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:34.441312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:34.441616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:34.442431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:34.444099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:34.484444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 878/1758] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:34.485696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:34.495076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:34.561245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302ffc7-11da-4c46-8409-64563e193c15 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:34.578832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df630-77d1-4529-87b3-3f9dd8a50845 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:34.579594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:34.583701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:34.586967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:34.587386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] PATH_INFO: `/v3/users/605369f77b004370b6b98f10f704539c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:34.590883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605369f77b004370b6b98f10f704539c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:34.596326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:34.597972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:34.598812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:34.599096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:34.599368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:34.600209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:34.603628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:34.652610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 881/1759] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:34 2022] POST /identity/v3/users => generated 306 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:34.659835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:34.664757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:34.693995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbefd1e-bd2d-4637-a00d-7e6434b6aadb admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:34.718241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:34.721132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:34.721416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:34.721710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] PATH_INFO: `/v3/users/434275fbdd4640ceb2fe4a20807e2c15` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:34.727812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=434275fbdd4640ceb2fe4a20807e2c15)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:34.731784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:34.778482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605369f77b004370b6b98f10f704539c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.799591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605369f77b004370b6b98f10f704539c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.800481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605369f77b004370b6b98f10f704539c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.801908 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605369f77b004370b6b98f10f704539c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.831364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605369f77b004370b6b98f10f704539c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.889290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434275fbdd4640ceb2fe4a20807e2c15'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.898376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 879/1760] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:34 2022] DELETE /identity/v3/users/605369f77b004370b6b98f10f704539c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:34.902852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:34.907537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:34.920379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434275fbdd4640ceb2fe4a20807e2c15'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.921134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434275fbdd4640ceb2fe4a20807e2c15'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.934196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434275fbdd4640ceb2fe4a20807e2c15'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:34.934870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434275fbdd4640ceb2fe4a20807e2c15'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:35.026997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 882/1761] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:34 2022] DELETE /identity/v3/users/434275fbdd4640ceb2fe4a20807e2c15 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:35.046566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:35.050518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:35.127873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ad405-b38e-4c1f-91ef-3a458f5d4363 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:35.298535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ddfb-6064-48b7-bdce-412a0b8e30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:35.300311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ddfb-6064-48b7-bdce-412a0b8e30e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:35.301163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ddfb-6064-48b7-bdce-412a0b8e30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:35.301792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ddfb-6064-48b7-bdce-412a0b8e30e4 admin admin] PATH_INFO: `/v3/projects/4619507065c74112bb17b12e4700a09d/users/af1bdd059ab14b2fa3f26bc4f5c72afc/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:35.336743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ddfb-6064-48b7-bdce-412a0b8e30e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4619507065c74112bb17b12e4700a09d, user_id=af1bdd059ab14b2fa3f26bc4f5c72afc, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:35.340960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ddfb-6064-48b7-bdce-412a0b8e30e4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:35.437210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 880/1762] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:34 2022] PUT /identity/v3/projects/4619507065c74112bb17b12e4700a09d/users/af1bdd059ab14b2fa3f26bc4f5c72afc/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:35.437210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3187ec-9e9a-4baa-892e-1201f4107366 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:35.437210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3187ec-9e9a-4baa-892e-1201f4107366 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:35.437210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3187ec-9e9a-4baa-892e-1201f4107366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:35.438443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8a1e-eb26-4efc-8421-eb3c091ea24e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:35.495499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2f3187ec-9e9a-4baa-892e-1201f4107366 None None] MFA Rules not processed for user `47deb39e5d954424a4fb4e97375443f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:35.498616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2f3187ec-9e9a-4baa-892e-1201f4107366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:35.582088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 881/1763] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:35.584164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004cad-74fa-4ae1-a5c6-95b66a322d9f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:35.584690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004cad-74fa-4ae1-a5c6-95b66a322d9f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:35.586645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004cad-74fa-4ae1-a5c6-95b66a322d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:35.615814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb599-d806-4919-895e-3defe1819b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:35.616917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb599-d806-4919-895e-3defe1819b17 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:35.617409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb599-d806-4919-895e-3defe1819b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:35.617924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb599-d806-4919-895e-3defe1819b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:35.618865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cb599-d806-4919-895e-3defe1819b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:35.620752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cb599-d806-4919-895e-3defe1819b17 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:35.630266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-50004cad-74fa-4ae1-a5c6-95b66a322d9f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:35.633125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-50004cad-74fa-4ae1-a5c6-95b66a322d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:35.662642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 883/1764] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 633 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:35.664308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255037a7-1f6e-4c50-a5c0-09e2e9e66b6a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:35.664742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255037a7-1f6e-4c50-a5c0-09e2e9e66b6a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:35.668406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255037a7-1f6e-4c50-a5c0-09e2e9e66b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:35.670887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 882/1765] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:35.671951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50004cad-74fa-4ae1-a5c6-95b66a322d9f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:35.694031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50004cad-74fa-4ae1-a5c6-95b66a322d9f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:35.726170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:35.727265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:35.727622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:35.740926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] PATH_INFO: `/v3/projects/c04750c99ed04ec3b170663d3298f6dd/users/cb557e7022fd406486d6bf06e0e02f1b/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:35.752574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-255037a7-1f6e-4c50-a5c0-09e2e9e66b6a None None] MFA Rules not processed for user `af1bdd059ab14b2fa3f26bc4f5c72afc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:35.754443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-255037a7-1f6e-4c50-a5c0-09e2e9e66b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:35.813872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04750c99ed04ec3b170663d3298f6dd, user_id=cb557e7022fd406486d6bf06e0e02f1b, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:35.821195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:35.897866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 883/1766] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:35 2022] PUT /identity/v3/projects/c04750c99ed04ec3b170663d3298f6dd/users/cb557e7022fd406486d6bf06e0e02f1b/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:35.899279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:35.908693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:36.043987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 884/1767] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:36.047962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255037a7-1f6e-4c50-a5c0-09e2e9e66b6a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:36.089130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255037a7-1f6e-4c50-a5c0-09e2e9e66b6a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:36.170959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baceea-f00b-47b5-80c5-8edd28acde57 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:36.174859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:36.175519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.175799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.176178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.250893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:36.251731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.252860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.253485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.254451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:36.256173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:36.278245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 885/1768] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:36.279394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:36.282983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:36.309069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587cbd0-2494-4e45-8f4f-b93dda5f7a9e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:36.326289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:36.327118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:36.329144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:36.329991 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.330377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.330755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.332678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:36.347202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:36.353697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 884/1769] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:36.354659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:36.364977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4e5a-b607-4db8-9c88-00b7ca1688b7 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:36.389408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72825-93f7-4cd7-8f9b-bb55d58ad276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:36.391323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72825-93f7-4cd7-8f9b-bb55d58ad276 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.391898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72825-93f7-4cd7-8f9b-bb55d58ad276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.392603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72825-93f7-4cd7-8f9b-bb55d58ad276 admin admin] PATH_INFO: `/v3/projects/c04750c99ed04ec3b170663d3298f6dd/users/cb557e7022fd406486d6bf06e0e02f1b/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.401558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72825-93f7-4cd7-8f9b-bb55d58ad276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04750c99ed04ec3b170663d3298f6dd, user_id=cb557e7022fd406486d6bf06e0e02f1b, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:36.407333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72825-93f7-4cd7-8f9b-bb55d58ad276 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:36.437556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 885/1770] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:36 2022] PUT /identity/v3/projects/c04750c99ed04ec3b170663d3298f6dd/users/cb557e7022fd406486d6bf06e0e02f1b/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:36.439824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.440059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.440330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.474778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 886/1771] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:36 2022] POST /identity/v3/projects => generated 393 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:36.491698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:36.522922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] MFA Rules not processed for user `cb557e7022fd406486d6bf06e0e02f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:36.528835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:36.635828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dbc52-f80d-42d1-a4fb-a8f7e0aec8e5 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:36.662784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:36.663497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.663776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.665193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.667251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:36.669194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:36.726972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 887/1772] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:36 2022] POST /identity/v3/users => generated 303 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:36.728473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:36.753972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08588a10-ed27-4fca-8e22-86656030549a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:36.777746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:36.777973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 886/1773] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:36.778643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.778923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.779191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.779914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:36.781641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:36.789194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:36.790658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:36.826825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 888/1774] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:36.831558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:36.867897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d4a7-ffb2-45e6-b692-7cd5c05ed44e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:36.874625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:36.875615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:36.875964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:36.876306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] PATH_INFO: `/v3/projects/cd5f64b52c78452c84c148927757f5d1/users/76d44e1264f64398a6c20182c1cc174a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:36.897045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5f64b52c78452c84c148927757f5d1, user_id=76d44e1264f64398a6c20182c1cc174a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:36.900553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:36.928762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 889/1775] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:36 2022] PUT /identity/v3/projects/cd5f64b52c78452c84c148927757f5d1/users/76d44e1264f64398a6c20182c1cc174a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:36.933111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:37.023710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddb237-971f-4aaf-bbc3-2d4314e3d1ff None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:37.098884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b0c2-471d-47a6-ad62-5c5a585ea244 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:37.116208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:37.116906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.117190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.117595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:37.118240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:37.127276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:37.147467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 890/1776] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:37.153495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:37.159674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11db21-9de9-42a6-bfc1-39f4919e7fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:37.160388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11db21-9de9-42a6-bfc1-39f4919e7fbc service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.160669 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11db21-9de9-42a6-bfc1-39f4919e7fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.160943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11db21-9de9-42a6-bfc1-39f4919e7fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:37.183301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505c98f-dcd1-4023-9210-f5c6d580e8a1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:37.201584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:37.205903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.205903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.205903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] PATH_INFO: `/v3/projects/cd5f64b52c78452c84c148927757f5d1/users/76d44e1264f64398a6c20182c1cc174a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:37.206504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5f64b52c78452c84c148927757f5d1, user_id=76d44e1264f64398a6c20182c1cc174a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:37.209187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:37.247587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 891/1777] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:37 2022] PUT /identity/v3/projects/cd5f64b52c78452c84c148927757f5d1/users/76d44e1264f64398a6c20182c1cc174a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:37.247587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:37.247587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:37.337526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11db21-9de9-42a6-bfc1-39f4919e7fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:37.350121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11db21-9de9-42a6-bfc1-39f4919e7fbc service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:37.395826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 887/1778] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:37.397303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f4807-ff34-43d0-97fa-f568910d0e0b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.397780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f4807-ff34-43d0-97fa-f568910d0e0b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.398072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f4807-ff34-43d0-97fa-f568910d0e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:37.400698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a756-5e5c-44d1-9de3-3d1a8c4c421f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:37.422110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:37.423070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.423360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.423640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] PATH_INFO: `/v3/projects/6045e93b579448f4a703c5f6ac0699fb` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:37.427195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6045e93b579448f4a703c5f6ac0699fb)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:37.433027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:37.476423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-cc8f4807-ff34-43d0-97fa-f568910d0e0b None None] MFA Rules not processed for user `76d44e1264f64398a6c20182c1cc174a`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:37.477820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cc8f4807-ff34-43d0-97fa-f568910d0e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:37.602731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6045e93b579448f4a703c5f6ac0699fb', 'request_id': 'req-0d081f38-244c-4ca4-b798-dce530e9881b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:37.610358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 888/1779] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:37.611917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f4807-ff34-43d0-97fa-f568910d0e0b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:37.617052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6045e93b579448f4a703c5f6ac0699fb', 'request_id': 'req-0d081f38-244c-4ca4-b798-dce530e9881b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:37.624272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6045e93b579448f4a703c5f6ac0699fb', 'request_id': 'req-0d081f38-244c-4ca4-b798-dce530e9881b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:37.647440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] The token cache is being invalidate because project 6045e93b579448f4a703c5f6ac0699fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:37.647730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:37.649587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:37.655794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 892/1780] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:37 2022] DELETE /identity/v3/projects/6045e93b579448f4a703c5f6ac0699fb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:37.656120 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:37.662273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:37.790518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f4807-ff34-43d0-97fa-f568910d0e0b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:37.804606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff33aa-887c-4941-b7da-d618af3af9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:37.806094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff33aa-887c-4941-b7da-d618af3af9cf service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.809793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff33aa-887c-4941-b7da-d618af3af9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.810132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff33aa-887c-4941-b7da-d618af3af9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:37.814481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d9ff33aa-887c-4941-b7da-d618af3af9cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:37.828707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d081f38-244c-4ca4-b798-dce530e9881b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:37.835021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:37.836027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.836556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.837195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:37.847687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:37.946555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff33aa-887c-4941-b7da-d618af3af9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:37.956875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff33aa-887c-4941-b7da-d618af3af9cf service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:37.986826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 889/1781] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:37.992442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4933c-bc0e-4dcd-a52c-2cf5fa9d5e6b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:37.992729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4933c-bc0e-4dcd-a52c-2cf5fa9d5e6b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:37.993003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4933c-bc0e-4dcd-a52c-2cf5fa9d5e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.023435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.024862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:38.063255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0ba4933c-bc0e-4dcd-a52c-2cf5fa9d5e6b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:38.064475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0ba4933c-bc0e-4dcd-a52c-2cf5fa9d5e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:38.071905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 893/1782] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:38.205686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:38.214477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e7d5-711d-44c9-b767-6ae2b44a4f4c service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:38.226651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9d965-d505-4fce-83ca-75bad509bdbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:38.227521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9d965-d505-4fce-83ca-75bad509bdbb service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.228109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9d965-d505-4fce-83ca-75bad509bdbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.228527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9d965-d505-4fce-83ca-75bad509bdbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.230118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 890/1783] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:38.234304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-72e9d965-d505-4fce-83ca-75bad509bdbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:38.237887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceff2-e6df-4e27-b490-b9c91c241133 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.238177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceff2-e6df-4e27-b490-b9c91c241133 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.238473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceff2-e6df-4e27-b490-b9c91c241133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.282646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2d0ceff2-e6df-4e27-b490-b9c91c241133 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:38.284327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2d0ceff2-e6df-4e27-b490-b9c91c241133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:38.304752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 891/1784] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:38.309813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceff2-e6df-4e27-b490-b9c91c241133 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:38.335142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceff2-e6df-4e27-b490-b9c91c241133 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:38.363303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a0de4-2876-4da9-818f-fa21e09095c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:38.364186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0de4-2876-4da9-818f-fa21e09095c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.364534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0de4-2876-4da9-818f-fa21e09095c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.364880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0de4-2876-4da9-818f-fa21e09095c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.365761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a0de4-2876-4da9-818f-fa21e09095c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:38.366143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a0de4-2876-4da9-818f-fa21e09095c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.367819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a0de4-2876-4da9-818f-fa21e09095c0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:38.411410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 892/1785] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:06:38.412997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb9fc4-f309-4a04-bdec-d511c4b22a78 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.414325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb9fc4-f309-4a04-bdec-d511c4b22a78 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.414767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb9fc4-f309-4a04-bdec-d511c4b22a78 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.421821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 893/1786] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 19:06:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:38.422977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb9fc4-f309-4a04-bdec-d511c4b22a78 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:38.456739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb9fc4-f309-4a04-bdec-d511c4b22a78 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:38.461256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9d965-d505-4fce-83ca-75bad509bdbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.466764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9d965-d505-4fce-83ca-75bad509bdbb service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:38.467333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:38.468603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.469110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.469650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.470614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.473451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:38.511329 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 894/1787] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:38.515736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.516332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.518703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.561886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:38.568350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 894/1788] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:38 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:38.571494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:38.574550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:38.739000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ec9c-55fb-4ce3-830a-3c74d96ee97c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:38.753275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:38.754100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 895/1789] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 19:06:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:38.754854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.755336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.755817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.757673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.763965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:38.780497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:38.781963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:38.821370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 895/1790] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:38 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:38.825007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:38.825373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0e7a0-d87f-4d36-97c9-45d491fb5c1d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:38.842998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36aa9b-a629-4879-a456-83d492ca830c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:38.848372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:38.849220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.849668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.849952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.859283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:38.860307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.860307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.860668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.861397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.863302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:38.893207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 896/1791] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:38.893369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.897288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:38.900237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:38.931377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 896/1792] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:38.943481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fec1b-17ba-43f3-a5cf-ec4c000ce525 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:38.966710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff124-b801-4ca0-b2df-74e6f11fdd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:38.969142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff124-b801-4ca0-b2df-74e6f11fdd9c admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:38.972806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff124-b801-4ca0-b2df-74e6f11fdd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:38.974228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff124-b801-4ca0-b2df-74e6f11fdd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:38.978847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff124-b801-4ca0-b2df-74e6f11fdd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:38.982124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff124-b801-4ca0-b2df-74e6f11fdd9c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:39.030189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:39.034532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 897/1793] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:39.044359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb9f2-9d37-4250-9e34-53ab7e6d85f5 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:39.051897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:39.053041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:39.053654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:39.054110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] PATH_INFO: `/v3/projects/e5775ed3e4994fdbaa725235741502a1/users/ca3f81c81e69493daa04c17c525624b6/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:39.127315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5775ed3e4994fdbaa725235741502a1, user_id=ca3f81c81e69493daa04c17c525624b6, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:39.137279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:39.177594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 897/1794] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:39 2022] PUT /identity/v3/projects/e5775ed3e4994fdbaa725235741502a1/users/ca3f81c81e69493daa04c17c525624b6/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:39.177881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:39.178215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:39.178489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:39.244947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] MFA Rules not processed for user `ca3f81c81e69493daa04c17c525624b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:39.247436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:39.380448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 898/1795] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:39.385860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:39.483604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:39.485095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:39.491779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833eac-7340-4121-8669-12300ca23b70 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:39.498564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:39.499542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:39.500004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:39.500448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:39.501302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:39.503794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:39.521613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc959eb-7686-4bf6-82f6-6381bb471b5b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:39.531705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:39.532288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:39.532572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:39.532956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] PATH_INFO: `/v3/projects/6d1e698ba9ce4c3198f8a41d29651084` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:39.536130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1e698ba9ce4c3198f8a41d29651084)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:39.538182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:39.554128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 898/1796] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:39 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:39.574994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:39.693122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1e698ba9ce4c3198f8a41d29651084', 'request_id': 'req-856debb0-4c1f-455c-a157-9ff2c87b59af'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:39.704377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1e698ba9ce4c3198f8a41d29651084', 'request_id': 'req-856debb0-4c1f-455c-a157-9ff2c87b59af'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:39.740279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1e698ba9ce4c3198f8a41d29651084', 'request_id': 'req-856debb0-4c1f-455c-a157-9ff2c87b59af'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:39.741519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245f935-ae37-4925-8f7c-3d33f50ebac7 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:39.765743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] The token cache is being invalidate because project 6d1e698ba9ce4c3198f8a41d29651084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:39.766287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:39.767241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-856debb0-4c1f-455c-a157-9ff2c87b59af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:39.771120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 899/1797] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:39 2022] DELETE /identity/v3/projects/6d1e698ba9ce4c3198f8a41d29651084 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:39.785056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06177-8797-4d48-9208-9aeb24c52020 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:39.785563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06177-8797-4d48-9208-9aeb24c52020 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:39.786096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06177-8797-4d48-9208-9aeb24c52020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:39.828744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-03a06177-8797-4d48-9208-9aeb24c52020 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:39.830228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-03a06177-8797-4d48-9208-9aeb24c52020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:39.898146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:39.898942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:39.899349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:39.899716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:39.900537 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:39.905283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:39.936516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 899/1798] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:39 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:39.940578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:39.943151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:39.967186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faefd55-8f69-443e-b44e-a10112d73d7e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:39.991701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 900/1799] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:39.992626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:39.993048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:39.993328 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:39.993646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:39.994412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:39.996042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.002472 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e6a6-91f0-4046-b71f-c12e4ff44c3c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.003001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e6a6-91f0-4046-b71f-c12e4ff44c3c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.003480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e6a6-91f0-4046-b71f-c12e4ff44c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.020198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 900/1800] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:40.021386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.059103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c291e6a6-91f0-4046-b71f-c12e4ff44c3c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:40.062069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c291e6a6-91f0-4046-b71f-c12e4ff44c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:40.067557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65071-1bb7-4e33-938f-33c02a57f23a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.077653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 901/1801] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:40.078783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e6a6-91f0-4046-b71f-c12e4ff44c3c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.079585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.081655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.082213 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.083423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.085820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.087861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.117231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 901/1802] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:40.118232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e6a6-91f0-4046-b71f-c12e4ff44c3c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.122489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.130629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.131905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.132497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.132923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.134147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:40.134616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.145676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaed0b-7afb-4f4b-9f13-20c4a71efc10 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.146826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.157268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a212c22-c72e-48ce-a43c-742e5101c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.158786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212c22-c72e-48ce-a43c-742e5101c712 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.158786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212c22-c72e-48ce-a43c-742e5101c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.158786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212c22-c72e-48ce-a43c-742e5101c712 admin admin] PATH_INFO: `/v3/projects/88e9690fd7cc45de9755554a96d733b1/users/2f3b4241cd714306a38fd36d10f24074/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.169209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 902/1803] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:40.179589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.186061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a212c22-c72e-48ce-a43c-742e5101c712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e9690fd7cc45de9755554a96d733b1, user_id=2f3b4241cd714306a38fd36d10f24074, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.190867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd384f4-4afa-44a1-b9af-d6b90a65d639 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.192711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a212c22-c72e-48ce-a43c-742e5101c712 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.196525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.197456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.198340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.198615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.199497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.201336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.234435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 902/1804] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:40 2022] PUT /identity/v3/projects/88e9690fd7cc45de9755554a96d733b1/users/2f3b4241cd714306a38fd36d10f24074/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:40.248256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92e1a-99b5-4c27-af50-d9e68e442cc0 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.248844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92e1a-99b5-4c27-af50-d9e68e442cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.249258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92e1a-99b5-4c27-af50-d9e68e442cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.273029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 903/1805] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:40 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:40.277173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.321865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-26e92e1a-99b5-4c27-af50-d9e68e442cc0 None None] MFA Rules not processed for user `2f3b4241cd714306a38fd36d10f24074`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:40.323185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-26e92e1a-99b5-4c27-af50-d9e68e442cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:40.404146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255cd8d-518e-40c9-8864-44dc5b9e1aef admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.411402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.412014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.412301 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.412580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.413940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.417817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.478500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 904/1806] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:40 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:40.483653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.501877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c47f4-57a2-4b6a-bc8f-0a92edaa04ff admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.513730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 903/1807] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:40.513833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.513833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.513833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.513833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.514159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.514753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.516540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e92e1a-99b5-4c27-af50-d9e68e442cc0 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.526226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 905/1808] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:40.530504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.536238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e92e1a-99b5-4c27-af50-d9e68e442cc0 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.542631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf3ab0-e432-4e68-adda-9d11c73180fd admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.543867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.544758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.545019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.545292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.546369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.548995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.549327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.549821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.550228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.550676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.551487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.553545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.569188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 906/1809] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:40.570284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.584245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3d83-fd0f-42c9-be7a-3f12d6d01a28 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.596047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 904/1810] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:40 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:40.600066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.600258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0843d-da33-458b-833d-d07cdb5f3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.601168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0843d-da33-458b-833d-d07cdb5f3fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.601444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0843d-da33-458b-833d-d07cdb5f3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.601736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0843d-da33-458b-833d-d07cdb5f3fcb admin admin] PATH_INFO: `/v3/projects/c3cf3f0e8429435b8086bff75fa4fd55/users/56fba90798e2416ebfa96ee1c274897e/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.624891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0843d-da33-458b-833d-d07cdb5f3fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cf3f0e8429435b8086bff75fa4fd55, user_id=56fba90798e2416ebfa96ee1c274897e, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.629451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0843d-da33-458b-833d-d07cdb5f3fcb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.698679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 907/1811] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:40 2022] PUT /identity/v3/projects/c3cf3f0e8429435b8086bff75fa4fd55/users/56fba90798e2416ebfa96ee1c274897e/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:40.701720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721f3c6-d38a-47a4-b918-96c962c54dfc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.702060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721f3c6-d38a-47a4-b918-96c962c54dfc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.702243 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721f3c6-d38a-47a4-b918-96c962c54dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.782145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8721f3c6-d38a-47a4-b918-96c962c54dfc None None] MFA Rules not processed for user `56fba90798e2416ebfa96ee1c274897e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:40.783354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8721f3c6-d38a-47a4-b918-96c962c54dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:40.793283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594d2af-aed8-4d05-9f9e-353a45f8ef93 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.863385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.864263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.865908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.865908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.866042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.868818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.905763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 905/1812] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:40 2022] POST /identity/v3/users => generated 295 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:40.914276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 908/1813] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:40.918578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.919589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721f3c6-d38a-47a4-b918-96c962c54dfc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.932455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a4db5-3ab3-4f97-80c2-de13ac3e134d admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.938360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.939441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.939864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.940502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.941393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.942570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721f3c6-d38a-47a4-b918-96c962c54dfc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.943421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.962654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 906/1814] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:40.964358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.965208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.965317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.965587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:40.966370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:40.971068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:40.973705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:40.989496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039893d-c693-4f90-ab04-cffbd63dbf1b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:40.996723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:40.997734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:40.998031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:40.998287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] PATH_INFO: `/v3/projects/1cc18244761b4197b61110987783f0fb/users/728531624c9b45e2a5a9633692e0b023/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.008817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 909/1815] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:40 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:41.018595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.030524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc18244761b4197b61110987783f0fb, user_id=728531624c9b45e2a5a9633692e0b023, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.040523 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.062537 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 907/1816] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:40 2022] PUT /identity/v3/projects/1cc18244761b4197b61110987783f0fb/users/728531624c9b45e2a5a9633692e0b023/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:41.066393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.157114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5914-db0d-496e-8e97-5c982f6e1ddd admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.171545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:41.172338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.172685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.172999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.173823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.175452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.190450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cf092-ca41-450c-ad9e-9e129a2e5b62 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.206395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 908/1817] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:41.208245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:41.211667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.212853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.217748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.218122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.219353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.221533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.246107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105c5c7-3e1d-483f-94b1-c0de0cc391de admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.252378 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52821237-bb1e-4191-bee4-1cb6268ebc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:41.254275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52821237-bb1e-4191-bee4-1cb6268ebc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.255043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52821237-bb1e-4191-bee4-1cb6268ebc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.255454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52821237-bb1e-4191-bee4-1cb6268ebc9b admin admin] PATH_INFO: `/v3/projects/1cc18244761b4197b61110987783f0fb/users/728531624c9b45e2a5a9633692e0b023/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.258204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52821237-bb1e-4191-bee4-1cb6268ebc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc18244761b4197b61110987783f0fb, user_id=728531624c9b45e2a5a9633692e0b023, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.266129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52821237-bb1e-4191-bee4-1cb6268ebc9b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.269074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 910/1818] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:41 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:41.274558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.293044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0489cd-80e8-42c2-94b1-2f7bbd38988d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.299525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 909/1819] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:41 2022] PUT /identity/v3/projects/1cc18244761b4197b61110987783f0fb/users/728531624c9b45e2a5a9633692e0b023/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:41.311316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4477a-ba23-4b5a-bd56-110146a9fc86 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.311605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4477a-ba23-4b5a-bd56-110146a9fc86 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.311883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4477a-ba23-4b5a-bd56-110146a9fc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.358875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-abc4477a-ba23-4b5a-bd56-110146a9fc86 None None] MFA Rules not processed for user `728531624c9b45e2a5a9633692e0b023`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:41.361292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-abc4477a-ba23-4b5a-bd56-110146a9fc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:41.481616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:41.482324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.482639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.482885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.515815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.524319 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.551335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 911/1820] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:41.554223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.595814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb6da-982d-4023-bf1c-8147e1e1670a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.602684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:41.603829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.604249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.604660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] PATH_INFO: `/v3/projects/eb2a4bf52f294b3e87bc1af68b294191/users/9ddb4f48cdd843be9a12a9437f5e36d6/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.650595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2a4bf52f294b3e87bc1af68b294191, user_id=9ddb4f48cdd843be9a12a9437f5e36d6, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.653501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.666180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 910/1821] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:41.679658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 912/1822] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:41 2022] PUT /identity/v3/projects/eb2a4bf52f294b3e87bc1af68b294191/users/9ddb4f48cdd843be9a12a9437f5e36d6/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:41.683975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4477a-ba23-4b5a-bd56-110146a9fc86 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.705285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4477a-ba23-4b5a-bd56-110146a9fc86 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.739376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.741214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:41.792512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:41.793334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.793759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.794104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.794902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.797079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.814723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 911/1823] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:41.819009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:41.832188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d741-a2cb-4b3f-975e-14ff8b2a9ad4 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.837820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f732b-6cae-4d05-9340-b52ef1b03cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:41.839376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f732b-6cae-4d05-9340-b52ef1b03cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.839718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f732b-6cae-4d05-9340-b52ef1b03cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.840004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f732b-6cae-4d05-9340-b52ef1b03cf0 admin admin] PATH_INFO: `/v3/projects/eb2a4bf52f294b3e87bc1af68b294191/users/9ddb4f48cdd843be9a12a9437f5e36d6/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.842305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f732b-6cae-4d05-9340-b52ef1b03cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2a4bf52f294b3e87bc1af68b294191, user_id=9ddb4f48cdd843be9a12a9437f5e36d6, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:41.845220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f732b-6cae-4d05-9340-b52ef1b03cf0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:41.856042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe2e33-c4e0-4d49-be1a-a2c7505837e8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:41.859814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 912/1824] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:41 2022] PUT /identity/v3/projects/eb2a4bf52f294b3e87bc1af68b294191/users/9ddb4f48cdd843be9a12a9437f5e36d6/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:41.872810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729156-cdeb-400e-be4a-239bf9d742f5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:41.873093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729156-cdeb-400e-be4a-239bf9d742f5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:41.873366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729156-cdeb-400e-be4a-239bf9d742f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:41.931527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-15729156-cdeb-400e-be4a-239bf9d742f5 None None] MFA Rules not processed for user `9ddb4f48cdd843be9a12a9437f5e36d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:41.933390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-15729156-cdeb-400e-be4a-239bf9d742f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:42.000382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:42.001177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:42.001580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:42.001927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:42.057916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 913/1825] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:42.111057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:42.113552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:42.134587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 913/1826] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:42.176277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15729156-cdeb-400e-be4a-239bf9d742f5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:42.195647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15729156-cdeb-400e-be4a-239bf9d742f5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:42.201379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:42.202901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:42.203190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:42.204526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:42.225264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:42.227182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:42.261216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 914/1827] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:42.270137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:42.271551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:42.284157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced560a6-dfd5-4717-9e67-61b1413ceeb5 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:42.289619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4529f1-b692-41d9-a05b-902ef5fd7074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:42.290521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4529f1-b692-41d9-a05b-902ef5fd7074 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:42.290973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4529f1-b692-41d9-a05b-902ef5fd7074 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:42.291940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4529f1-b692-41d9-a05b-902ef5fd7074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:42.294178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ae4529f1-b692-41d9-a05b-902ef5fd7074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:42.361674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4529f1-b692-41d9-a05b-902ef5fd7074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:42.363194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4529f1-b692-41d9-a05b-902ef5fd7074 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:42.386386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 914/1828] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:42.463560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:42.474904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eefc1-1c65-43ea-aba1-ff2ce22dc65a service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:42.480909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01e665-cd2f-4f9a-8c74-7f11444407d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:42.481842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01e665-cd2f-4f9a-8c74-7f11444407d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:42.482266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01e665-cd2f-4f9a-8c74-7f11444407d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:42.482717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01e665-cd2f-4f9a-8c74-7f11444407d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:42.560107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01e665-cd2f-4f9a-8c74-7f11444407d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:42.562366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01e665-cd2f-4f9a-8c74-7f11444407d3 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:42.593419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 915/1829] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:42.903832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0124875-f163-4418-bde4-36e4ce49e1b6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:42.904239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0124875-f163-4418-bde4-36e4ce49e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:42.904561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0124875-f163-4418-bde4-36e4ce49e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:42.938736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a0124875-f163-4418-bde4-36e4ce49e1b6 None None] MFA Rules not processed for user `d54ad9809c8241a18d88fa6cd960badd`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:42.940044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a0124875-f163-4418-bde4-36e4ce49e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:43.026541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 915/1830] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:43.362668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8725b-5915-4c66-9625-33bdb82f2c3e None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:43.363200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8725b-5915-4c66-9625-33bdb82f2c3e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:43.363200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8725b-5915-4c66-9625-33bdb82f2c3e None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:43.364778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 916/1831] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 19:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:43.390335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:43.390631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:43.390911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:43.432116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:43.433319 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:43.524721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 916/1832] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 19:06:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:43.549123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8725b-5915-4c66-9625-33bdb82f2c3e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:43.551226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5de8725b-5915-4c66-9625-33bdb82f2c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:43.571605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8725b-5915-4c66-9625-33bdb82f2c3e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:43.592140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:43.592931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:43.593336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:43.593738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:43.607048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:43.609084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:43.630932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 917/1833] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:43.856838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:43.859297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:43.905868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:43.909040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:44.063222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bb39e-844f-456b-bb7d-9e9942ec522a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:44.068204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:44.069094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:44.069541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:44.069820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] PATH_INFO: `/v3/users/af1bdd059ab14b2fa3f26bc4f5c72afc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:44.072714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1bdd059ab14b2fa3f26bc4f5c72afc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:44.076930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:44.078140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f411d-ef1e-4e73-93fd-83f562064d41 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:44.087268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:44.088284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:44.088564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:44.088837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] PATH_INFO: `/v3/users/2ec743a7794c40f5b204307be1d166d2` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:44.090140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec743a7794c40f5b204307be1d166d2)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:44.093701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:44.153265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1bdd059ab14b2fa3f26bc4f5c72afc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.176394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1bdd059ab14b2fa3f26bc4f5c72afc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.179039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1bdd059ab14b2fa3f26bc4f5c72afc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.180498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1bdd059ab14b2fa3f26bc4f5c72afc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.210777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-369235cc-1615-40be-8a31-7ed29729ef2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1bdd059ab14b2fa3f26bc4f5c72afc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.221196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec743a7794c40f5b204307be1d166d2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.239310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec743a7794c40f5b204307be1d166d2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.245401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec743a7794c40f5b204307be1d166d2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.267645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec743a7794c40f5b204307be1d166d2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.269245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-39cb8c15-3adb-4c75-b21f-2fe202ca1dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec743a7794c40f5b204307be1d166d2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:44.295027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 917/1834] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:43 2022] DELETE /identity/v3/users/af1bdd059ab14b2fa3f26bc4f5c72afc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:44.297494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:44.302569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:44.302861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:44.323964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 918/1835] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:43 2022] DELETE /identity/v3/users/2ec743a7794c40f5b204307be1d166d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:44.328889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:44.329986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:44.334103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:44.345983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:44.363976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:44.409767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:44.414287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:44.538764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 918/1836] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:44.567614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:44.569366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:44.585515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 919/1837] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:44.612843 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:44.614941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:44.694026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06059ec-c3a9-4a98-b1a2-5a8036da72e1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:44.699640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:44.700293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:44.700739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:44.701180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:44.715830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:44.719451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:44.731528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b14c6-f769-489b-886e-203f212051f5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:44.735962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:44.737810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:44.738317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:44.738728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:44.750001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 919/1838] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:44.751720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:44.753631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:44.767203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 920/1839] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:45.395848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:45.398167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:45.432039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762457-375c-4890-b646-0211c56f5821 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:45.444080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:45.448103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:45.448560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:45.450461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] PATH_INFO: `/v3/projects/125fb12dd2e84a1e9afab5d453926c02` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:45.453386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125fb12dd2e84a1e9afab5d453926c02)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:45.469724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:45.547939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125fb12dd2e84a1e9afab5d453926c02', 'request_id': 'req-5a1555fe-46e4-4287-af92-b72d1a5d5a95'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.556569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125fb12dd2e84a1e9afab5d453926c02', 'request_id': 'req-5a1555fe-46e4-4287-af92-b72d1a5d5a95'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.574726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125fb12dd2e84a1e9afab5d453926c02', 'request_id': 'req-5a1555fe-46e4-4287-af92-b72d1a5d5a95'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.598396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] The token cache is being invalidate because project 125fb12dd2e84a1e9afab5d453926c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:45.598963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.599892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.601790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 920/1840] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:45 2022] DELETE /identity/v3/projects/125fb12dd2e84a1e9afab5d453926c02 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:45.606834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:45.619734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52312ff-a0ae-4e9d-bf55-ebd977f82fed service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:45.732576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:45.734477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:45.735005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:45.735292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] PATH_INFO: `/v3/users/cb557e7022fd406486d6bf06e0e02f1b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:45.737178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb557e7022fd406486d6bf06e0e02f1b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:45.740226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:45.806212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb557e7022fd406486d6bf06e0e02f1b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.815645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb557e7022fd406486d6bf06e0e02f1b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.816774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb557e7022fd406486d6bf06e0e02f1b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.835666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb557e7022fd406486d6bf06e0e02f1b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.836741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb557e7022fd406486d6bf06e0e02f1b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:45.866243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 921/1841] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:45 2022] DELETE /identity/v3/users/cb557e7022fd406486d6bf06e0e02f1b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:46.059813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:46.061147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:46.077356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1555fe-46e4-4287-af92-b72d1a5d5a95 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:46.176484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:46.177941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:46.178089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:46.178345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] PATH_INFO: `/v3/projects/4619507065c74112bb17b12e4700a09d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:46.179858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4619507065c74112bb17b12e4700a09d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:46.182674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:46.293892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4619507065c74112bb17b12e4700a09d', 'request_id': 'req-5c8df0fc-e5ed-4421-9211-6d2a533b1007'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.302914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4619507065c74112bb17b12e4700a09d', 'request_id': 'req-5c8df0fc-e5ed-4421-9211-6d2a533b1007'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.313965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:46.315507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:46.319576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4619507065c74112bb17b12e4700a09d', 'request_id': 'req-5c8df0fc-e5ed-4421-9211-6d2a533b1007'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.345939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c61e1-1d7d-4faa-9f56-a6d27f8ec6d8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:46.346103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] The token cache is being invalidate because project 4619507065c74112bb17b12e4700a09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:46.346380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.347328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.350532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 921/1842] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:46 2022] DELETE /identity/v3/projects/4619507065c74112bb17b12e4700a09d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:46.358209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:46.360785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:46.530592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:46.531692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df0fc-e5ed-4421-9211-6d2a533b1007 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:46.534564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:46.534864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:46.536327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] PATH_INFO: `/v3/users/ca3f81c81e69493daa04c17c525624b6` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:46.538451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3f81c81e69493daa04c17c525624b6)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:46.544476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:46.545635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:46.546304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:46.546768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:46.547275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] PATH_INFO: `/v3/users/76d44e1264f64398a6c20182c1cc174a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:46.549245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d44e1264f64398a6c20182c1cc174a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:46.551677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:46.644495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d44e1264f64398a6c20182c1cc174a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.670488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d44e1264f64398a6c20182c1cc174a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.671235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d44e1264f64398a6c20182c1cc174a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.672155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d44e1264f64398a6c20182c1cc174a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.683359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-958249da-f9c7-446a-8093-cc9c33871ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d44e1264f64398a6c20182c1cc174a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.692987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3f81c81e69493daa04c17c525624b6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.740845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3f81c81e69493daa04c17c525624b6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.741906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3f81c81e69493daa04c17c525624b6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.764069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 922/1843] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:46 2022] DELETE /identity/v3/users/76d44e1264f64398a6c20182c1cc174a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:46.774692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3f81c81e69493daa04c17c525624b6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.776757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3f81c81e69493daa04c17c525624b6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:46.845787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 922/1844] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:46 2022] DELETE /identity/v3/users/ca3f81c81e69493daa04c17c525624b6 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:46.847812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c26b-0e24-411d-9af7-97482d89aaa5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:46.848094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c26b-0e24-411d-9af7-97482d89aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:46.848363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c26b-0e24-411d-9af7-97482d89aaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:46.875204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a878c26b-0e24-411d-9af7-97482d89aaa5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:46.876723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a878c26b-0e24-411d-9af7-97482d89aaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:46.984195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 923/1845] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:47.007750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:47.009396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.090724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28c8c3-43b8-49a7-aa65-bd75e859f1ec admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:47.099976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:47.101111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.101638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.102081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.116527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:47.119119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:47.122806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d232f-b8fd-48d6-b048-61b5a0887856 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.123169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d232f-b8fd-48d6-b048-61b5a0887856 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.123491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d232f-b8fd-48d6-b048-61b5a0887856 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.125998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 924/1846] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 19:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:06:47.139897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 923/1847] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:47.148797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.149107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.149366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.168403 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:47.169646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.261015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 925/1848] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 19:06:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:47.379197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:47.383157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.396331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:47.398538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.413500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b99326-b2db-4f15-8d54-43f6f1c12bd6 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:47.422664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942274-4cb3-497b-b9aa-10c6a6410d9d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:47.424110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:47.424710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.425054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.425292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.437533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:47.442020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.442324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.442601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] PATH_INFO: `/v3/projects/c04750c99ed04ec3b170663d3298f6dd` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.445899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04750c99ed04ec3b170663d3298f6dd)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:47.448456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:47.460019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:47.461638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:47.477283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 924/1849] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:47.539428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04750c99ed04ec3b170663d3298f6dd', 'request_id': 'req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.551341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04750c99ed04ec3b170663d3298f6dd', 'request_id': 'req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.571904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04750c99ed04ec3b170663d3298f6dd', 'request_id': 'req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.587902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] The token cache is being invalidate because project c04750c99ed04ec3b170663d3298f6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:47.588418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.589360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e6c1569-d09d-4fd3-b9a0-2ac94a899b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.590763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:47.591851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 926/1850] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:47 2022] DELETE /identity/v3/projects/c04750c99ed04ec3b170663d3298f6dd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:47.593694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.598529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.598677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.599257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.612823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189499b3-5310-4675-8817-be6c78f90e54 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:47.647179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:47.648450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.700283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:47.701226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.701734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.702196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] PATH_INFO: `/v3/projects/cd5f64b52c78452c84c148927757f5d1` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.703476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5f64b52c78452c84c148927757f5d1)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:47.705440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:47.725489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 927/1851] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:47.726457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:47.729427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.746633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848610-41ff-4a87-8822-4b081a3fc992 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:47.753061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:47.755517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.755892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.756236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] PATH_INFO: `/v3/projects/e5775ed3e4994fdbaa725235741502a1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.757538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5775ed3e4994fdbaa725235741502a1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:47.759889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:47.770672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5f64b52c78452c84c148927757f5d1', 'request_id': 'req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.786410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5f64b52c78452c84c148927757f5d1', 'request_id': 'req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.792847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5f64b52c78452c84c148927757f5d1', 'request_id': 'req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.804743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] The token cache is being invalidate because project cd5f64b52c78452c84c148927757f5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:47.805032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.805726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19bf5e4b-76b7-4dfe-b0c6-5d25fa7a3559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.808025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 925/1852] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:47 2022] DELETE /identity/v3/projects/cd5f64b52c78452c84c148927757f5d1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:47.809417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.809740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.810017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.820546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5775ed3e4994fdbaa725235741502a1', 'request_id': 'req-72f1c627-1668-4f30-bfb1-2a7268824295'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.828571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5775ed3e4994fdbaa725235741502a1', 'request_id': 'req-72f1c627-1668-4f30-bfb1-2a7268824295'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.828717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:47.831180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.836405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5775ed3e4994fdbaa725235741502a1', 'request_id': 'req-72f1c627-1668-4f30-bfb1-2a7268824295'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.848038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] The token cache is being invalidate because project e5775ed3e4994fdbaa725235741502a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:47.848380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.848962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-72f1c627-1668-4f30-bfb1-2a7268824295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.850751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 928/1853] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:47 2022] DELETE /identity/v3/projects/e5775ed3e4994fdbaa725235741502a1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:47.851774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fa13c-87fc-4949-8f40-d59e9ab49702 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.852043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fa13c-87fc-4949-8f40-d59e9ab49702 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.852311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fa13c-87fc-4949-8f40-d59e9ab49702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.871169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-557fa13c-87fc-4949-8f40-d59e9ab49702 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:47.872304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-557fa13c-87fc-4949-8f40-d59e9ab49702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.900554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 926/1854] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:47.901746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:47.903203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.915019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c678f-93d9-4ea0-94ab-64e7d99cfee0 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:47.920334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:47.921188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.921487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.921772 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] PATH_INFO: `/v3/users/2f3b4241cd714306a38fd36d10f24074` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.923061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3b4241cd714306a38fd36d10f24074)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:47.924956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:47.936260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 929/1855] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:47.937169 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fa13c-87fc-4949-8f40-d59e9ab49702 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:47.946880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fa13c-87fc-4949-8f40-d59e9ab49702 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:47.952747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98521c3a-3e85-498d-a076-96c0c41bdf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:47.953385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98521c3a-3e85-498d-a076-96c0c41bdf18 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.953787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98521c3a-3e85-498d-a076-96c0c41bdf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.953992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98521c3a-3e85-498d-a076-96c0c41bdf18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.954751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98521c3a-3e85-498d-a076-96c0c41bdf18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:47.955051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98521c3a-3e85-498d-a076-96c0c41bdf18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:47.956679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98521c3a-3e85-498d-a076-96c0c41bdf18 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:47.968936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 930/1856] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:47.970820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:47.970820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:47.970820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:47.977741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3b4241cd714306a38fd36d10f24074'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.985406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3b4241cd714306a38fd36d10f24074'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.986251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3b4241cd714306a38fd36d10f24074'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.989653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:47.990915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:47.993661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3b4241cd714306a38fd36d10f24074'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.994878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3b4241cd714306a38fd36d10f24074'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:47.999734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 931/1857] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:48.002279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.003585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.012070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 927/1858] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:47 2022] DELETE /identity/v3/users/2f3b4241cd714306a38fd36d10f24074 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:48.012869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.015113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f031a9-4db1-4256-991d-6c814f5be1ed None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.080309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.080966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.081244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.081557 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.082239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.084927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.088618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565305f-cb9e-4ed2-9e3d-d2d1fff48ec8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.093815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.094475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.094756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.095024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.095751 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:48.096053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.097681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.111880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 928/1859] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:48.117089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 932/1860] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:47 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:48.118027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.120927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.130530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c35d3-2d1e-44e2-8769-42ff7963657a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.201367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855332-95fd-4d4e-b649-0b02eb48335c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.208210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.209011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.209396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.209800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.210624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.212651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.225659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.226358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.226647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.226914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.227593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.230224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.239341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 933/1861] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:48 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:48.240368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.261206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 929/1862] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:48 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:48.266927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.268356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8380-61a2-4e57-8e03-10eaf191419b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.349658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.349862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9fd5-3156-404d-8445-76248fecc004 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.350670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.351114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.351526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.352625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.354954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.355261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.355944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.356626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.356904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.357616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.359542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.368585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 934/1863] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:48.370642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.374136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.391830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 930/1864] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:48 2022] POST /identity/v3/users => generated 305 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:48.392015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94758-e83a-4c0a-a05c-64c7e412a6dc admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.392925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.399488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.401007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.401290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.401609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] PATH_INFO: `/v3/projects/88e9690fd7cc45de9755554a96d733b1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.402839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e9690fd7cc45de9755554a96d733b1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.404374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9438-d73c-4ee7-ae3e-a86a69d93d92 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.404858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.409054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.409838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.410093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.410363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.411078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.412659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.424455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 931/1865] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:48.425302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.436231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fa97-a94a-44c0-b0a1-53588404ac62 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.441741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.442386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.442738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.443021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.443814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.445496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.457382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 932/1866] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:48.458035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.465851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e9690fd7cc45de9755554a96d733b1', 'request_id': 'req-b1285895-90c2-4b36-a106-215198636536'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.470038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32111ab-8e7e-4706-b3f0-67b12c2cbc52 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.471311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e9690fd7cc45de9755554a96d733b1', 'request_id': 'req-b1285895-90c2-4b36-a106-215198636536'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.479183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e9690fd7cc45de9755554a96d733b1', 'request_id': 'req-b1285895-90c2-4b36-a106-215198636536'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.491117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] The token cache is being invalidate because project 88e9690fd7cc45de9755554a96d733b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:48.491400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.492100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.493850 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 935/1867] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:48 2022] DELETE /identity/v3/projects/88e9690fd7cc45de9755554a96d733b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:48.496814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.497826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.524441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.525886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.526186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.526458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] PATH_INFO: `/v3/projects/0ca43cf5a2854c53a993f1cd98c4d5d6/users/85efd819a07143e6883d80c71e5c1490/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.540308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca43cf5a2854c53a993f1cd98c4d5d6, user_id=85efd819a07143e6883d80c71e5c1490, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.542999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.556415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 933/1868] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:48 2022] PUT /identity/v3/projects/0ca43cf5a2854c53a993f1cd98c4d5d6/users/85efd819a07143e6883d80c71e5c1490/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:48.557243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.562331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285895-90c2-4b36-a106-215198636536 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.564724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.616535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d00ed-12fc-49d9-aa7d-bbe2d75e7fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.617198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d00ed-12fc-49d9-aa7d-bbe2d75e7fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.617484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d00ed-12fc-49d9-aa7d-bbe2d75e7fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.617777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d00ed-12fc-49d9-aa7d-bbe2d75e7fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.618516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d00ed-12fc-49d9-aa7d-bbe2d75e7fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.620156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d00ed-12fc-49d9-aa7d-bbe2d75e7fa5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.625163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c51fd-44d3-454f-8cd0-77ef12b443d2 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.629934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.630399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 936/1869] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:48.630796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.631073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.631338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] PATH_INFO: `/v3/users/728531624c9b45e2a5a9633692e0b023` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.631716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.632007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.632289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.634557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=728531624c9b45e2a5a9633692e0b023)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.636945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.658380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] MFA Rules not processed for user `85efd819a07143e6883d80c71e5c1490`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:48.659582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.681790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728531624c9b45e2a5a9633692e0b023'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.688938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728531624c9b45e2a5a9633692e0b023'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.689892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728531624c9b45e2a5a9633692e0b023'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.699017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728531624c9b45e2a5a9633692e0b023'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.699900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728531624c9b45e2a5a9633692e0b023'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:48.722380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 934/1870] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:48 2022] DELETE /identity/v3/users/728531624c9b45e2a5a9633692e0b023 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:48.722380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.722380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.730135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 937/1871] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:48.734047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.735638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.752642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f8fd-9646-4f2d-9837-9a7e0730c85b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.791970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663a038-6070-483b-a153-31b60de35ffe admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.796934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4052a0-610c-463a-b439-bf7f9d112080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.797916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4052a0-610c-463a-b439-bf7f9d112080 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.798528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4052a0-610c-463a-b439-bf7f9d112080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.798528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4052a0-610c-463a-b439-bf7f9d112080 admin admin] PATH_INFO: `/v3/projects/f03776e5558c4b54b79922fe8a41842b/users/26a6644db0714b8fbfaf5339d179ea16/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.817744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4052a0-610c-463a-b439-bf7f9d112080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03776e5558c4b54b79922fe8a41842b, user_id=26a6644db0714b8fbfaf5339d179ea16, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.820712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4052a0-610c-463a-b439-bf7f9d112080 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.823454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.825110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.825740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.826002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.826821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.829232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:48.840641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 935/1872] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:48 2022] PUT /identity/v3/projects/f03776e5558c4b54b79922fe8a41842b/users/26a6644db0714b8fbfaf5339d179ea16/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:48.852595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dcb1-e643-48c8-9000-4b6bb82c5664 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.853231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dcb1-e643-48c8-9000-4b6bb82c5664 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.854001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dcb1-e643-48c8-9000-4b6bb82c5664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.866829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 938/1873] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:48 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:48.871357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:48.893093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-eb04dcb1-e643-48c8-9000-4b6bb82c5664 None None] MFA Rules not processed for user `26a6644db0714b8fbfaf5339d179ea16`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:48.895381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-eb04dcb1-e643-48c8-9000-4b6bb82c5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:48.971183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef316a-5e20-4b40-964b-ef2f4e8530ec admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:48.976212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:48.976880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:48.977158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:48.977425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:48.978136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:48.980162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.000164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 936/1874] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:49.004407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04dcb1-e643-48c8-9000-4b6bb82c5664 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.005867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 939/1875] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:48 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:49.010984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.018629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04dcb1-e643-48c8-9000-4b6bb82c5664 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.021233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe67f3-6104-4452-8147-3a779a73c6e5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.026181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.026937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.027283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.027611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.028396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.030101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.030352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.031034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.031400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.031690 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.033191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.035745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.041544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 940/1876] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:49.044978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.064239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb61837-f2cb-4217-8d54-cd8f071a950b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.069214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.070155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.070495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.070756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] PATH_INFO: `/v3/projects/f9bae527b7b747af8374da13fa7bbde4/users/4260d8682915416681252d6776794997/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.085304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 937/1877] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:49 2022] POST /identity/v3/projects => generated 409 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:49.089339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.093489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bae527b7b747af8374da13fa7bbde4, user_id=4260d8682915416681252d6776794997, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.096422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.120185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 941/1878] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:49 2022] PUT /identity/v3/projects/f9bae527b7b747af8374da13fa7bbde4/users/4260d8682915416681252d6776794997/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:49.124432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.171857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34dd7e-f378-47bc-99c4-21e1bc63b411 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.218499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d622d6-2e54-4e15-88f7-89eca20b3697 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.224692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.225503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.225840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.226178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.226968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.229212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.232513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.233308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.233629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.233908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.234590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.236527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.240505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 942/1879] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:06:49.241547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.243562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:49.258422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c06a8-466f-4fec-a73c-83a9dc51075d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.258938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 938/1880] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:49 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:49.259795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.267258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.268426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.268658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.268931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] PATH_INFO: `/v3/projects/1cc18244761b4197b61110987783f0fb` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.269968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d2052-fc1c-43f9-81f9-9ea228f19489 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.270329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc18244761b4197b61110987783f0fb)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.272272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.274949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.276025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.276307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.276611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] PATH_INFO: `/v3/projects/f9bae527b7b747af8374da13fa7bbde4/users/4260d8682915416681252d6776794997/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.278679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bae527b7b747af8374da13fa7bbde4, user_id=4260d8682915416681252d6776794997, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.281333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.297516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 939/1881] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:49 2022] PUT /identity/v3/projects/f9bae527b7b747af8374da13fa7bbde4/users/4260d8682915416681252d6776794997/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:49.297516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.329593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc18244761b4197b61110987783f0fb', 'request_id': 'req-5b2d05be-9130-422c-a807-29c6473fd2b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:49.335140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc18244761b4197b61110987783f0fb', 'request_id': 'req-5b2d05be-9130-422c-a807-29c6473fd2b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:49.343831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc18244761b4197b61110987783f0fb', 'request_id': 'req-5b2d05be-9130-422c-a807-29c6473fd2b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:49.359073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] The token cache is being invalidate because project 1cc18244761b4197b61110987783f0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:49.359526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:49.360070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5b2d05be-9130-422c-a807-29c6473fd2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:49.361712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 943/1882] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:49 2022] DELETE /identity/v3/projects/1cc18244761b4197b61110987783f0fb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:49.363021 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.363307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.363695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.372044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59640a-3af3-49b1-9132-ec53f97e603f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.390608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] MFA Rules not processed for user `4260d8682915416681252d6776794997`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:49.391820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:49.425619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb550b-ffeb-4b77-8f61-d2ceab4fced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.426205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb550b-ffeb-4b77-8f61-d2ceab4fced3 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.426479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb550b-ffeb-4b77-8f61-d2ceab4fced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.426748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb550b-ffeb-4b77-8f61-d2ceab4fced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.427453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb550b-ffeb-4b77-8f61-d2ceab4fced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.429021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb550b-ffeb-4b77-8f61-d2ceab4fced3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.440430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 940/1883] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:49.441990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.442277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.442553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.457854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 944/1884] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:49.459657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:49.460841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:49.462221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.464040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:49.477411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 941/1885] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:49.477411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.477411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:49.477973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e71ba-cb9b-486f-ac9e-08a89ecafff0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.484323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273c998-8482-437a-ac12-95ac3a4a106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.485233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c998-8482-437a-ac12-95ac3a4a106e admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.485545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c998-8482-437a-ac12-95ac3a4a106e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.485820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c998-8482-437a-ac12-95ac3a4a106e admin admin] PATH_INFO: `/v3/projects/a1f2cba001554ad89c62230d68d0de13/users/94ff341b6c954d82bce9c6d15ccc096d/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.502550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273c998-8482-437a-ac12-95ac3a4a106e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f2cba001554ad89c62230d68d0de13, user_id=94ff341b6c954d82bce9c6d15ccc096d, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.505186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273c998-8482-437a-ac12-95ac3a4a106e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.530740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 945/1886] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:49 2022] PUT /identity/v3/projects/a1f2cba001554ad89c62230d68d0de13/users/94ff341b6c954d82bce9c6d15ccc096d/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:49.530740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71bee-e056-41ac-8b2c-77a329124134 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.530740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71bee-e056-41ac-8b2c-77a329124134 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.530740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71bee-e056-41ac-8b2c-77a329124134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.549197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bf779-39b5-4c12-9015-a5ec17557c14 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.549395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-90f71bee-e056-41ac-8b2c-77a329124134 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:49.550859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-90f71bee-e056-41ac-8b2c-77a329124134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:49.642297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.643224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.644767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.644767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.685359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 946/1887] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:49.688614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71bee-e056-41ac-8b2c-77a329124134 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.721566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.723492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.729570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71bee-e056-41ac-8b2c-77a329124134 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.736546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.738097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.738397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.738863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.739673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.742218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.742617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 942/1888] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:49.743671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.755576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda91dc2-c09b-46d0-a618-085850b8598e service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.757121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 947/1889] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:49.760814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.761586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.762295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.762577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.762853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.763677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:49.763980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.773335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.780758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3e43-9660-4ecf-8cda-6ba6e69ba94d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.789415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 943/1890] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:49.794668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98185369-8191-43c8-b78a-5af15ea7d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.794882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.795864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185369-8191-43c8-b78a-5af15ea7d432 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.796147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185369-8191-43c8-b78a-5af15ea7d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.796417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185369-8191-43c8-b78a-5af15ea7d432 admin admin] PATH_INFO: `/v3/projects/a1f2cba001554ad89c62230d68d0de13/users/94ff341b6c954d82bce9c6d15ccc096d/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.801838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98185369-8191-43c8-b78a-5af15ea7d432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f2cba001554ad89c62230d68d0de13, user_id=94ff341b6c954d82bce9c6d15ccc096d, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.804493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98185369-8191-43c8-b78a-5af15ea7d432 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.820266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c463a83-19fa-448e-8b8d-f3c5e06a093b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:49.868693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 948/1891] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:49 2022] PUT /identity/v3/projects/a1f2cba001554ad89c62230d68d0de13/users/94ff341b6c954d82bce9c6d15ccc096d/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:49.880933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463eacc-194f-4fb6-83c2-1f92b97fb9c0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.881238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463eacc-194f-4fb6-83c2-1f92b97fb9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.881749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463eacc-194f-4fb6-83c2-1f92b97fb9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.933684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:49.934583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:49.935007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:49.935485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:49.936205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:49.938802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:49.961370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9463eacc-194f-4fb6-83c2-1f92b97fb9c0 None None] MFA Rules not processed for user `94ff341b6c954d82bce9c6d15ccc096d`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:49.962573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9463eacc-194f-4fb6-83c2-1f92b97fb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:49.993017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 944/1892] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:49 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:49.994170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:49.996302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.098229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74f4e1-0ff3-47f7-9173-1625b006df7c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.104340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.105316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.105840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.106235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] PATH_INFO: `/v3/users/85efd819a07143e6883d80c71e5c1490` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.107686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85efd819a07143e6883d80c71e5c1490)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.110781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:50.115429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 949/1893] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:50.115429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463eacc-194f-4fb6-83c2-1f92b97fb9c0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.136000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463eacc-194f-4fb6-83c2-1f92b97fb9c0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.143393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.144086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.144367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.144773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.145481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.148807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:50.193489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 950/1894] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:50 2022] POST /identity/v3/users => generated 284 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:50.195033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.207267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85efd819a07143e6883d80c71e5c1490'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:50.220531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85efd819a07143e6883d80c71e5c1490'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:50.221346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85efd819a07143e6883d80c71e5c1490'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:50.239193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85efd819a07143e6883d80c71e5c1490'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:50.239901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85efd819a07143e6883d80c71e5c1490'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:50.262032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 945/1895] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:49 2022] DELETE /identity/v3/users/85efd819a07143e6883d80c71e5c1490 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:50.263046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.265000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.325448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a80416-e2b3-4a1c-a991-36cbd4a21a0a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.401091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a3557-3519-45e3-9f12-0af144ef5f73 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.406260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061709a9-ce25-4a69-8ac1-3645ea941153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.407295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061709a9-ce25-4a69-8ac1-3645ea941153 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.407788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061709a9-ce25-4a69-8ac1-3645ea941153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.408233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061709a9-ce25-4a69-8ac1-3645ea941153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.409126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061709a9-ce25-4a69-8ac1-3645ea941153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.411175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061709a9-ce25-4a69-8ac1-3645ea941153 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:50.425145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 946/1896] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:50.425145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ac8e-cd40-414f-b978-f23f7eed679f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.425145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ac8e-cd40-414f-b978-f23f7eed679f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.425145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ac8e-cd40-414f-b978-f23f7eed679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.426823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.427570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.427919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.428269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.430275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.443587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-de15ac8e-cd40-414f-b978-f23f7eed679f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:50.444722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-de15ac8e-cd40-414f-b978-f23f7eed679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.456854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 947/1897] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:50.457805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ac8e-cd40-414f-b978-f23f7eed679f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.467734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ac8e-cd40-414f-b978-f23f7eed679f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.473768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.474532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.475153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.475153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.476250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.477878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:50.493116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 948/1898] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:50.493116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.493687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.521538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.523228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:50.535597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 951/1899] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:50.536275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.550868 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44cdf9-bd70-45aa-9e9f-dbd6e629e129 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.563947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.564858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.565140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.565417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] PATH_INFO: `/v3/projects/028a5718bd24406691f4b34cbe34cd0c/users/f5753a6c5bf64dae8e644f9e7ddbfe30/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.573767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c37d5d-f316-46fc-b415-f569ac69839c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.578351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efe284-e6dc-4a54-9507-806491a0e6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.579148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efe284-e6dc-4a54-9507-806491a0e6fa service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.580017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efe284-e6dc-4a54-9507-806491a0e6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.580296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efe284-e6dc-4a54-9507-806491a0e6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.595688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028a5718bd24406691f4b34cbe34cd0c, user_id=f5753a6c5bf64dae8e644f9e7ddbfe30, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.597955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efe284-e6dc-4a54-9507-806491a0e6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.598086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:50.600080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efe284-e6dc-4a54-9507-806491a0e6fa service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:50.626437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 949/1900] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:50.638767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 952/1901] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:50 2022] PUT /identity/v3/projects/028a5718bd24406691f4b34cbe34cd0c/users/f5753a6c5bf64dae8e644f9e7ddbfe30/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:50.642559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.643179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.643474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.678397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] MFA Rules not processed for user `f5753a6c5bf64dae8e644f9e7ddbfe30`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:50.680757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.801123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 950/1902] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:50.807085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.810070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:50.811628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.931802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3a072-0e97-4c27-a2bb-0b4600c62e9a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.942149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.942825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.943107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.943384 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.949754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:50.981683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f3ae5-1474-4a40-8183-85346e1eb5b8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:50.988355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:50.989351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:50.989859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:50.990347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:50.991752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:50.995390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.074478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 953/1903] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:50 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:51.076608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.144782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:51.149173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.174999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 951/1904] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:51.211058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d8bb-c7f0-42bb-9ec7-6c001da34df7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:51.216982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:51.217924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:51.218342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:51.218751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:51.219570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:51.222235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.260742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.268860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 954/1905] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:51 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:51.270257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc2086-24d8-4b07-acdd-ccaabb6abd90 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:51.274902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:51.275617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:51.275895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:51.276166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:51.277226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:51.278870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.290473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 952/1906] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:51.294664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.309013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77468cb9-9c6b-4400-beb8-b885a122d842 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:51.315118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:51.315484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:51.315764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:51.316204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] PATH_INFO: `/v3/projects/c050a76432374dd0b40ca89e36053330/users/5997a3f55d594472baca59013cc5ece7/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:51.339638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c050a76432374dd0b40ca89e36053330, user_id=5997a3f55d594472baca59013cc5ece7, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:51.344350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.393037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.404146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 955/1907] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:51 2022] PUT /identity/v3/projects/c050a76432374dd0b40ca89e36053330/users/5997a3f55d594472baca59013cc5ece7/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:51.406541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2984fc-eba9-486c-954d-082f5e3de337 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:51.479359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb2618-0b1e-43fa-9527-87b7a4c27328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:51.480035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2618-0b1e-43fa-9527-87b7a4c27328 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:51.480311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2618-0b1e-43fa-9527-87b7a4c27328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:51.480581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2618-0b1e-43fa-9527-87b7a4c27328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:51.481489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb2618-0b1e-43fa-9527-87b7a4c27328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:51.483613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb2618-0b1e-43fa-9527-87b7a4c27328 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.499627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.506089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 953/1908] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:51.510211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c5db-22a2-4106-a1f3-ebe932f3db90 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:51.515225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:51.516123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:51.516396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:51.516664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] PATH_INFO: `/v3/projects/c050a76432374dd0b40ca89e36053330/users/5997a3f55d594472baca59013cc5ece7/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:51.519642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c050a76432374dd0b40ca89e36053330, user_id=5997a3f55d594472baca59013cc5ece7, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:51.522484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.535954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 956/1909] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:51 2022] PUT /identity/v3/projects/c050a76432374dd0b40ca89e36053330/users/5997a3f55d594472baca59013cc5ece7/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:51.547169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648dce3-01e5-4272-b9ca-8d2afc040a37 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:51.547458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648dce3-01e5-4272-b9ca-8d2afc040a37 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:51.547723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648dce3-01e5-4272-b9ca-8d2afc040a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:51.566687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.568631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:51.625543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e648dce3-01e5-4272-b9ca-8d2afc040a37 None None] MFA Rules not processed for user `5997a3f55d594472baca59013cc5ece7`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:51.626260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e648dce3-01e5-4272-b9ca-8d2afc040a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:51.691452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17079548-3c31-41e7-99ae-acb4535194af admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:51.698313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:51.699536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:51.699916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:51.700284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] PATH_INFO: `/v3/projects/0ca43cf5a2854c53a993f1cd98c4d5d6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:51.701660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca43cf5a2854c53a993f1cd98c4d5d6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:51.705789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:51.772253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 954/1910] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:51.781195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648dce3-01e5-4272-b9ca-8d2afc040a37 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.827724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca43cf5a2854c53a993f1cd98c4d5d6', 'request_id': 'req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:51.844977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca43cf5a2854c53a993f1cd98c4d5d6', 'request_id': 'req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:51.854931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca43cf5a2854c53a993f1cd98c4d5d6', 'request_id': 'req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:51.881587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] The token cache is being invalidate because project 0ca43cf5a2854c53a993f1cd98c4d5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:51.881880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:51.882778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:51.885349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 957/1911] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:51 2022] DELETE /identity/v3/projects/0ca43cf5a2854c53a993f1cd98c4d5d6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:51.890427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:51.892803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:51.904781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648dce3-01e5-4272-b9ca-8d2afc040a37 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:52.012654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:52.015009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:52.015663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:52.016829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:52.022989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:52.036622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1fb21-38ce-44c8-8a88-c1aa1d642b55 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:52.048167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:52.049749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:52.049928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:52.053254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] PATH_INFO: `/v3/users/4260d8682915416681252d6776794997` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:52.053254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4260d8682915416681252d6776794997)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:52.056374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:52.166633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4260d8682915416681252d6776794997'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:52.186696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4260d8682915416681252d6776794997'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:52.187421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4260d8682915416681252d6776794997'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:52.188182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4260d8682915416681252d6776794997'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:52.189142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:52.191127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:52.195939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4260d8682915416681252d6776794997'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:52.204871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 955/1912] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:52.260466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 958/1913] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:51 2022] DELETE /identity/v3/users/4260d8682915416681252d6776794997 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:52.427284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:52.430563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:52.448474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125b60-90f0-47f3-85f4-fba850151db8 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:52.568842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87332cec-398f-41a3-beb2-dfc2be7a0a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:52.569787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332cec-398f-41a3-beb2-dfc2be7a0a0c service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:52.570135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332cec-398f-41a3-beb2-dfc2be7a0a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:52.570517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332cec-398f-41a3-beb2-dfc2be7a0a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:52.573321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-87332cec-398f-41a3-beb2-dfc2be7a0a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:52.678017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87332cec-398f-41a3-beb2-dfc2be7a0a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:52.680186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87332cec-398f-41a3-beb2-dfc2be7a0a0c service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:52.713955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 956/1914] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:52.988957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:52.990409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:53.176387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e59e6f-4c46-41ff-b169-35e377ee0118 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.183489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.184406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.184829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.185152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] PATH_INFO: `/v3/projects/f9bae527b7b747af8374da13fa7bbde4` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.186567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9bae527b7b747af8374da13fa7bbde4)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.188876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.277304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9bae527b7b747af8374da13fa7bbde4', 'request_id': 'req-501cc752-be61-4619-8b38-fe2c41e86618'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:53.286390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9bae527b7b747af8374da13fa7bbde4', 'request_id': 'req-501cc752-be61-4619-8b38-fe2c41e86618'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:53.296010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9bae527b7b747af8374da13fa7bbde4', 'request_id': 'req-501cc752-be61-4619-8b38-fe2c41e86618'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:53.322681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] The token cache is being invalidate because project f9bae527b7b747af8374da13fa7bbde4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:53.322974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:53.324239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-501cc752-be61-4619-8b38-fe2c41e86618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:53.330892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add727b1-551d-4111-b380-824b19589857 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.331340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add727b1-551d-4111-b380-824b19589857 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.331503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add727b1-551d-4111-b380-824b19589857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.333108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 959/1915] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:52 2022] DELETE /identity/v3/projects/f9bae527b7b747af8374da13fa7bbde4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:53.362760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-add727b1-551d-4111-b380-824b19589857 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:53.363955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-add727b1-551d-4111-b380-824b19589857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:53.425010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 957/1916] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:53.432651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe597-6556-49c0-8558-54e71de0985f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.432936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe597-6556-49c0-8558-54e71de0985f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.433212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe597-6556-49c0-8558-54e71de0985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.450784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ddefe597-6556-49c0-8558-54e71de0985f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:53.452024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ddefe597-6556-49c0-8558-54e71de0985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:53.459783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 960/1917] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:53.464723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add727b1-551d-4111-b380-824b19589857 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.474343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add727b1-551d-4111-b380-824b19589857 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.479446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.480062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.480333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.480601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.481310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:53.481648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.483234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.494739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 958/1918] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:53.499000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe597-6556-49c0-8558-54e71de0985f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.508318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe597-6556-49c0-8558-54e71de0985f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.513065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.513715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.513995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.514303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.515049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.517110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.546613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 961/1919] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:53 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:53.548003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.558591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1660d-1f96-4453-9791-9773f90685ef admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.618332 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.619033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.619476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.619763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.620460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.622478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.654597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 959/1920] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:53 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:53.655917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.666994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0452ca-b3fe-4245-a7a7-32c742a8a845 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.671625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.672286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.672566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.672841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.673602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.675198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.685395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 962/1921] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:53.689390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.699135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f02e0-7221-4cce-813b-fd219433443e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.703635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842f26-5447-44ee-a64c-ba964c504a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.704287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842f26-5447-44ee-a64c-ba964c504a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.704564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842f26-5447-44ee-a64c-ba964c504a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.704834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842f26-5447-44ee-a64c-ba964c504a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.705569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842f26-5447-44ee-a64c-ba964c504a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.707145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842f26-5447-44ee-a64c-ba964c504a2e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.717577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 960/1922] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:53.721356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.732035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387351af-130a-4188-a1cd-3d88d854960e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.736882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.737441 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.737746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.738016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] PATH_INFO: `/v3/projects/95ce49ef986b40b3a00d0aedcf9a4e70/users/6e857d72c6ef40768840603481936226/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.752457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ce49ef986b40b3a00d0aedcf9a4e70, user_id=6e857d72c6ef40768840603481936226, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.755179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.768933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 963/1923] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:53 2022] PUT /identity/v3/projects/95ce49ef986b40b3a00d0aedcf9a4e70/users/6e857d72c6ef40768840603481936226/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:53.781242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5b28a-4ef2-45b6-bf03-348a9eaf6886 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.781567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5b28a-4ef2-45b6-bf03-348a9eaf6886 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.781852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5b28a-4ef2-45b6-bf03-348a9eaf6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.808180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d1b5b28a-4ef2-45b6-bf03-348a9eaf6886 None None] MFA Rules not processed for user `6e857d72c6ef40768840603481936226`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:53.809392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d1b5b28a-4ef2-45b6-bf03-348a9eaf6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:53.872139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 961/1924] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:53.873664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.876385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:53.876511 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5b28a-4ef2-45b6-bf03-348a9eaf6886 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:53.940636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5b28a-4ef2-45b6-bf03-348a9eaf6886 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.941183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277517f-837e-4474-9f53-818aeafd9f7a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:53.945867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.946714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:53.947586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.947871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.948141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:53.948260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.948438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:53.948705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] PATH_INFO: `/v3/users/56fba90798e2416ebfa96ee1c274897e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:53.948827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.949950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fba90798e2416ebfa96ee1c274897e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:53.950754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.951902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:53.976364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 962/1925] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:53 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:53.980244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.007143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fba90798e2416ebfa96ee1c274897e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.015045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fba90798e2416ebfa96ee1c274897e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.015680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fba90798e2416ebfa96ee1c274897e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.016306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fba90798e2416ebfa96ee1c274897e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.023213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9685fbd3-2e01-4384-ad19-d4a59561c16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fba90798e2416ebfa96ee1c274897e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.041634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 964/1926] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:53 2022] DELETE /identity/v3/users/56fba90798e2416ebfa96ee1c274897e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:54.041788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac862-65c9-445a-ab46-eba6c5c81370 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.044636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08835378-ea49-4b95-9bee-017544462102 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.044927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08835378-ea49-4b95-9bee-017544462102 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.045201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08835378-ea49-4b95-9bee-017544462102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.066246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-08835378-ea49-4b95-9bee-017544462102 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:54.067439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-08835378-ea49-4b95-9bee-017544462102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:54.102382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.103207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.103486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.103759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.104440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.106399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.131474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 963/1927] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:53 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:54.135648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.137271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 965/1928] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:54.137663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:54.151289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323133-3edf-459b-80bd-c37f66d89df1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.157569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08835378-ea49-4b95-9bee-017544462102 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.159678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.160429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-08835378-ea49-4b95-9bee-017544462102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:54.160579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.160754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.160996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.161759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.163345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.178603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 964/1929] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:06:54.179944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.191489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e129c-d1db-4e7b-bc3c-ec3b0103887f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.197582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.198769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.199246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.199589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] PATH_INFO: `/v3/projects/f838b7286ce2402cbb1cc556f877c786/users/bb1cf8050cc84df3b6ff3c22e466a07a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.215624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f838b7286ce2402cbb1cc556f877c786, user_id=bb1cf8050cc84df3b6ff3c22e466a07a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.222576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.224517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08835378-ea49-4b95-9bee-017544462102 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.232018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.232755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.232958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.233409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.256235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.257731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.264299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 965/1930] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:54 2022] PUT /identity/v3/projects/f838b7286ce2402cbb1cc556f877c786/users/bb1cf8050cc84df3b6ff3c22e466a07a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:54.265638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.269580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 966/1931] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:54.330222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630880-4795-4e42-b348-e955784f8eff admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.336474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff0f5b-ff43-40c5-8907-ead15b3c4276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.337527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff0f5b-ff43-40c5-8907-ead15b3c4276 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.337638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff0f5b-ff43-40c5-8907-ead15b3c4276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.337888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff0f5b-ff43-40c5-8907-ead15b3c4276 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.338648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff0f5b-ff43-40c5-8907-ead15b3c4276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.340237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff0f5b-ff43-40c5-8907-ead15b3c4276 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.350949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 966/1932] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:06:54.355429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.364797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309ef6-2ebf-4b60-9ddb-3824cc74af83 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.371069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.371960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.372259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.372497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] PATH_INFO: `/v3/projects/f838b7286ce2402cbb1cc556f877c786/users/bb1cf8050cc84df3b6ff3c22e466a07a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.374720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f838b7286ce2402cbb1cc556f877c786, user_id=bb1cf8050cc84df3b6ff3c22e466a07a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.378329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.390976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 967/1933] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:54 2022] PUT /identity/v3/projects/f838b7286ce2402cbb1cc556f877c786/users/bb1cf8050cc84df3b6ff3c22e466a07a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:54.402526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.402815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.403090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.443536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] MFA Rules not processed for user `bb1cf8050cc84df3b6ff3c22e466a07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:54.444868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:54.525586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 967/1934] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:54.536366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.538145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:54.562600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.564235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:54.615531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9ca16-a720-4e9e-ba1f-b0f2f096e5e6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.620015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.620673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.620950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.621213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.630161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.631628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.639137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4137a-8854-4390-b62e-f3b33d7ff42c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.641085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 968/1935] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:54.645174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.646631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.646989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.647181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] PATH_INFO: `/v3/projects/c3cf3f0e8429435b8086bff75fa4fd55` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.648389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cf3f0e8429435b8086bff75fa4fd55)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.650388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.701077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cf3f0e8429435b8086bff75fa4fd55', 'request_id': 'req-2ccd4c2a-54a4-4182-9bb4-716615e658ea'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.708440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cf3f0e8429435b8086bff75fa4fd55', 'request_id': 'req-2ccd4c2a-54a4-4182-9bb4-716615e658ea'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.713893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cf3f0e8429435b8086bff75fa4fd55', 'request_id': 'req-2ccd4c2a-54a4-4182-9bb4-716615e658ea'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.724958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] The token cache is being invalidate because project c3cf3f0e8429435b8086bff75fa4fd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:54.725244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.725914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.727472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 968/1936] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:54 2022] DELETE /identity/v3/projects/c3cf3f0e8429435b8086bff75fa4fd55 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:54.732224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:54.742354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871129-b944-4507-aa5b-8e8574bcd361 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:54.801875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:54.802748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:54.803024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:54.803288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] PATH_INFO: `/v3/users/9ddb4f48cdd843be9a12a9437f5e36d6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:54.804494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddb4f48cdd843be9a12a9437f5e36d6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:54.806981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:54.852768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddb4f48cdd843be9a12a9437f5e36d6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.862469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddb4f48cdd843be9a12a9437f5e36d6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.863117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddb4f48cdd843be9a12a9437f5e36d6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.863730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddb4f48cdd843be9a12a9437f5e36d6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.870605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddb4f48cdd843be9a12a9437f5e36d6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:54.886715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 969/1937] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:54 2022] DELETE /identity/v3/users/9ddb4f48cdd843be9a12a9437f5e36d6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:55.163773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.165295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:55.179505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd4c2a-54a4-4182-9bb4-716615e658ea admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.234795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.236245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:55.241656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.242527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.243134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.243134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] PATH_INFO: `/v3/projects/eb2a4bf52f294b3e87bc1af68b294191` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.244971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2a4bf52f294b3e87bc1af68b294191)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.248306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.249954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0fd1-af3a-4b21-965d-218292e75b3f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.255792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.256742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.257082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.257482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] PATH_INFO: `/v3/users/6e857d72c6ef40768840603481936226` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.259986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e857d72c6ef40768840603481936226)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.262515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.321649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2a4bf52f294b3e87bc1af68b294191', 'request_id': 'req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.340945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2a4bf52f294b3e87bc1af68b294191', 'request_id': 'req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.360186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2a4bf52f294b3e87bc1af68b294191', 'request_id': 'req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.379529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e857d72c6ef40768840603481936226'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.399310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e857d72c6ef40768840603481936226'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.401207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e857d72c6ef40768840603481936226'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.402032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e857d72c6ef40768840603481936226'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.402448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] The token cache is being invalidate because project eb2a4bf52f294b3e87bc1af68b294191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:55.403459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.405038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2bc12697-be20-4c82-903a-4bb1cd7d9a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.411780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 969/1938] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:55 2022] DELETE /identity/v3/projects/eb2a4bf52f294b3e87bc1af68b294191 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:55.414246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dccd-0f3a-4a2f-b4a6-5c67a5a1e9c2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.414540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dccd-0f3a-4a2f-b4a6-5c67a5a1e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.414819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dccd-0f3a-4a2f-b4a6-5c67a5a1e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.415559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-88db5d55-48c8-4949-8c95-3b5746f0e83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e857d72c6ef40768840603481936226'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:55.448531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 970/1939] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:55 2022] DELETE /identity/v3/users/6e857d72c6ef40768840603481936226 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:55.453176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.453488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.453781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.454138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-af58dccd-0f3a-4a2f-b4a6-5c67a5a1e9c2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:55.455462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-af58dccd-0f3a-4a2f-b4a6-5c67a5a1e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:55.486807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:55.487957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:55.529219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 970/1940] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:55.536872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c667b-8c12-41c5-ba78-374f042b3f12 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.537166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c667b-8c12-41c5-ba78-374f042b3f12 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.537443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c667b-8c12-41c5-ba78-374f042b3f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.544390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 971/1941] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:55.554544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.555885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0a6c667b-8c12-41c5-ba78-374f042b3f12 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:55.555991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:55.557121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0a6c667b-8c12-41c5-ba78-374f042b3f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:55.565646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 971/1942] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:55.569700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c667b-8c12-41c5-ba78-374f042b3f12 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.578992 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c667b-8c12-41c5-ba78-374f042b3f12 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.584554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.585205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.585504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.586162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.586887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:55.587193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.589892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.601841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 972/1943] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:55.605983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.617990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253f398-cc8a-47b1-aa4c-a54bb33fc765 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.623428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.624077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.624362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.624638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.625316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.627244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.630466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80c6d-d249-4ede-bdcd-eac9ba2e2515 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.635535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.636277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.636805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.636805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.646955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.648397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.655647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 973/1944] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:55 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:55.660369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.662910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 972/1945] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:55.724093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4c32-567d-4d6e-8965-3358885570f3 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.731342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.731903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.732069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.732347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.733208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.735686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.764689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 974/1946] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:55 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:55.769337 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.778905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9a514-460a-4af0-8ee2-90672aa6d5f6 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.783603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.784290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.784568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.784837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.785574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.787157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.800658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 973/1947] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:55.801930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.812639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f5d2e-f3b5-4e54-a107-6d5df35c56c1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.817237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c7a55-c007-4ebb-9665-e9dcd5778b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.817941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c7a55-c007-4ebb-9665-e9dcd5778b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.818225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c7a55-c007-4ebb-9665-e9dcd5778b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.818502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c7a55-c007-4ebb-9665-e9dcd5778b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.819218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c7a55-c007-4ebb-9665-e9dcd5778b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.820807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c7a55-c007-4ebb-9665-e9dcd5778b4d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.831412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 975/1948] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:55.836133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.846471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef5f26-bbf4-4b2e-8f93-4201111fbae8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:55.851606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:55.852558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.852814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.853136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] PATH_INFO: `/v3/projects/b8127b2d6db44e61a7ab7c9cfa357481/users/d1412abf3bfb44ada551722b70ee161b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.867837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8127b2d6db44e61a7ab7c9cfa357481, user_id=d1412abf3bfb44ada551722b70ee161b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:55.871095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:55.885544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 974/1949] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:55 2022] PUT /identity/v3/projects/b8127b2d6db44e61a7ab7c9cfa357481/users/d1412abf3bfb44ada551722b70ee161b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:55.896834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129341-c817-44dc-8d43-9e9538eba81c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:55.897122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129341-c817-44dc-8d43-9e9538eba81c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:55.897402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129341-c817-44dc-8d43-9e9538eba81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:55.922851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-37129341-c817-44dc-8d43-9e9538eba81c None None] MFA Rules not processed for user `d1412abf3bfb44ada551722b70ee161b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:55.924163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-37129341-c817-44dc-8d43-9e9538eba81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:55.958674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:55.960719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:56.021374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 976/1950] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:56.022254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129341-c817-44dc-8d43-9e9538eba81c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.035662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009cf3f-a6e2-4eab-a500-05d8fc6fa530 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.041999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.042697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.042980 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.043454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] PATH_INFO: `/v3/projects/95ce49ef986b40b3a00d0aedcf9a4e70` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.044748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ce49ef986b40b3a00d0aedcf9a4e70)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.046932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.085524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129341-c817-44dc-8d43-9e9538eba81c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.094886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ce49ef986b40b3a00d0aedcf9a4e70', 'request_id': 'req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.100089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ce49ef986b40b3a00d0aedcf9a4e70', 'request_id': 'req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.108600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ce49ef986b40b3a00d0aedcf9a4e70', 'request_id': 'req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.122657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] The token cache is being invalidate because project 95ce49ef986b40b3a00d0aedcf9a4e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:56.122939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.123638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.125766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 975/1951] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:55 2022] DELETE /identity/v3/projects/95ce49ef986b40b3a00d0aedcf9a4e70 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:56.130094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.131765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:56.148970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.149670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.149980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.150251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.151013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.152903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.179161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 977/1952] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:56 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:56.184343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.187216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:56.202126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bb335-8d9a-4aec-8ab9-e3be862d02ae admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.249241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd2439-9230-48d1-9412-c0bd21586c6a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.255926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.256635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.257014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.257314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.257540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.258033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.258494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.258778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.259053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] PATH_INFO: `/v3/users/bb1cf8050cc84df3b6ff3c22e466a07a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.260005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.260284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1cf8050cc84df3b6ff3c22e466a07a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.262251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.282325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 978/1953] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:56 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:56.283369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.294310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92835ab-b2fd-4335-b895-3b6a1ff92e4b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.299061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.299699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.299983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.300254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.300960 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.302644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.310658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1cf8050cc84df3b6ff3c22e466a07a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.313546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 979/1954] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:06:56.318817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.319455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1cf8050cc84df3b6ff3c22e466a07a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.320208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1cf8050cc84df3b6ff3c22e466a07a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.320989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1cf8050cc84df3b6ff3c22e466a07a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.330782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1cf8050cc84df3b6ff3c22e466a07a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:56.331411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13297bdb-bbf2-4bd5-80d6-1039f37da7e3 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.341160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.343131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.344221 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.344603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] PATH_INFO: `/v3/projects/4e975cfe45034a1595dbebec84a379ce/users/7c8c5b9c982746a1aebb97274702dbb0/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.365096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e975cfe45034a1595dbebec84a379ce, user_id=7c8c5b9c982746a1aebb97274702dbb0, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.368187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.374841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 976/1955] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:56 2022] DELETE /identity/v3/users/bb1cf8050cc84df3b6ff3c22e466a07a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:56.392269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 980/1956] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:56 2022] PUT /identity/v3/projects/4e975cfe45034a1595dbebec84a379ce/users/7c8c5b9c982746a1aebb97274702dbb0/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:56.394594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.396203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:56.519611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a139e38-1c0e-49fa-8b62-8061077c68a4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.675345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3822a-dab5-4d12-b1ba-bc2295e9b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.676170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3822a-dab5-4d12-b1ba-bc2295e9b66e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.676449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3822a-dab5-4d12-b1ba-bc2295e9b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.676794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3822a-dab5-4d12-b1ba-bc2295e9b66e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.677630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3822a-dab5-4d12-b1ba-bc2295e9b66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.679822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3822a-dab5-4d12-b1ba-bc2295e9b66e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.718113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 977/1957] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:56.722010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.736935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d257e-4618-4079-92cd-6a961b256656 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.746181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.747623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.748223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.748868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] PATH_INFO: `/v3/projects/4e975cfe45034a1595dbebec84a379ce/users/7c8c5b9c982746a1aebb97274702dbb0/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.752470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e975cfe45034a1595dbebec84a379ce, user_id=7c8c5b9c982746a1aebb97274702dbb0, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:56.755978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:56.779769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 981/1958] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:56 2022] PUT /identity/v3/projects/4e975cfe45034a1595dbebec84a379ce/users/7c8c5b9c982746a1aebb97274702dbb0/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:56.790365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.790798 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.791139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.847366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] MFA Rules not processed for user `7c8c5b9c982746a1aebb97274702dbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:56.848878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:56.989132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 978/1959] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:57.003084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.006296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.093603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10533f42-a355-4e55-9d75-a9ab0c47cb41 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.112813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.112813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.112813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.112813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.125879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.127402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.133212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.135400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.160626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 982/1960] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:57.202100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.237743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66463d8-d59f-4c93-b857-214e58a59c4f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.243423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.244926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.245296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.245802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] PATH_INFO: `/v3/projects/f838b7286ce2402cbb1cc556f877c786` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.247115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f838b7286ce2402cbb1cc556f877c786)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.249196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.276897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953d2c-c7a0-4ef1-802d-8dc0a4aa775a service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.281983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.282858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.283136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.283401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] PATH_INFO: `/v3/users/d1412abf3bfb44ada551722b70ee161b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.284605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1412abf3bfb44ada551722b70ee161b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.286502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.295838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f838b7286ce2402cbb1cc556f877c786', 'request_id': 'req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.300939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f838b7286ce2402cbb1cc556f877c786', 'request_id': 'req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.308996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f838b7286ce2402cbb1cc556f877c786', 'request_id': 'req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.322075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] The token cache is being invalidate because project f838b7286ce2402cbb1cc556f877c786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:57.322889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.323566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5550e2b6-e56a-484c-8334-e3ecd90ba3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.329062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 979/1961] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:57 2022] DELETE /identity/v3/projects/f838b7286ce2402cbb1cc556f877c786 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:57.330556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7535b-b466-436c-9608-30e09678de10 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.330832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7535b-b466-436c-9608-30e09678de10 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.331205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7535b-b466-436c-9608-30e09678de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.339317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1412abf3bfb44ada551722b70ee161b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.350005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1fa7535b-b466-436c-9608-30e09678de10 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:57.351458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1fa7535b-b466-436c-9608-30e09678de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.363466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1412abf3bfb44ada551722b70ee161b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.364455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1412abf3bfb44ada551722b70ee161b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.379944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1412abf3bfb44ada551722b70ee161b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.380927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c66c63e6-d3a6-4e8b-8857-da5e4c7f427a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1412abf3bfb44ada551722b70ee161b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:57.405932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 983/1962] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:57 2022] DELETE /identity/v3/users/d1412abf3bfb44ada551722b70ee161b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:57.407563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.407854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.408211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.427290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:57.428496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.434483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 980/1963] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:57.442195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c4264-4de7-4bfc-a753-79edfc6e7a45 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.442632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c4264-4de7-4bfc-a753-79edfc6e7a45 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.442993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c4264-4de7-4bfc-a753-79edfc6e7a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.463061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c64c4264-4de7-4bfc-a753-79edfc6e7a45 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:57.464463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c64c4264-4de7-4bfc-a753-79edfc6e7a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.493098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 984/1964] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:57.503844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.505269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.524577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 981/1965] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:57.528673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c4264-4de7-4bfc-a753-79edfc6e7a45 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.536967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c4264-4de7-4bfc-a753-79edfc6e7a45 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.542063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.542696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.542968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.543234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.543939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:57.544247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.545847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.560878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 982/1966] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:06:57.562081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.562513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5168b31-5383-4198-afc5-f39cb257e46d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.566154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.566794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.567071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.567333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.571824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df4ff3-0eaa-402e-a6db-6ce1126a2d20 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.576160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.576801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.577421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.577622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.577734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.577991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.578652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.580609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.586827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 985/1967] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:57.609328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 983/1968] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:57 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:57.610470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.621177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567cfaf-dd89-46a7-a5f1-8e6fb1e9720e service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.679280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.679930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.680246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.680592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.681928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.683905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.704035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 986/1969] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:57 2022] POST /identity/v3/users => generated 280 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:06:57.708402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.718482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98930aa7-1bed-419d-b25f-795a422228e8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.726467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.727142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.727417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.727685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.728931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.731489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.750208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 984/1970] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:57.754453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.765124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceacfa-fe32-483c-a3cb-0addf257ba9a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.771541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e55f1-82b0-4b3f-a37d-b5fdbfcdc279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.772249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e55f1-82b0-4b3f-a37d-b5fdbfcdc279 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.772550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e55f1-82b0-4b3f-a37d-b5fdbfcdc279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.772830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e55f1-82b0-4b3f-a37d-b5fdbfcdc279 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.773605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e55f1-82b0-4b3f-a37d-b5fdbfcdc279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.775342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e55f1-82b0-4b3f-a37d-b5fdbfcdc279 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.792206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 987/1971] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:57.796470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.807234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e008124-edde-4e60-9c20-8f8f38f93e3c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:57.822238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:57.823148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.823724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.823724 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] PATH_INFO: `/v3/projects/23a544cf9e75426dbc7004bf9249bc5a/users/62a16348b5534562adf192ca1fccc626/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.851698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a544cf9e75426dbc7004bf9249bc5a, user_id=62a16348b5534562adf192ca1fccc626, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.856888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.873595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 985/1972] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:57 2022] PUT /identity/v3/projects/23a544cf9e75426dbc7004bf9249bc5a/users/62a16348b5534562adf192ca1fccc626/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:57.884373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:57.884876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:57.885277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:57.901782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:57.903621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.939661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] MFA Rules not processed for user `62a16348b5534562adf192ca1fccc626`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:57.941052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.035247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7da1c-4766-4df0-847b-91396ed89538 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:58.041196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:58.042346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.042731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.043099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] PATH_INFO: `/v3/projects/b8127b2d6db44e61a7ab7c9cfa357481` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.046454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8127b2d6db44e61a7ab7c9cfa357481)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:58.048887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:58.101775 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 988/1973] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:57 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:58.159211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:58.161875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.168776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8127b2d6db44e61a7ab7c9cfa357481', 'request_id': 'req-6ff5ce6b-8162-42bb-b019-4fce6802c496'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.175150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8127b2d6db44e61a7ab7c9cfa357481', 'request_id': 'req-6ff5ce6b-8162-42bb-b019-4fce6802c496'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.187144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8127b2d6db44e61a7ab7c9cfa357481', 'request_id': 'req-6ff5ce6b-8162-42bb-b019-4fce6802c496'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.205443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] The token cache is being invalidate because project b8127b2d6db44e61a7ab7c9cfa357481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:58.205834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.206863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.209740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 986/1974] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:57 2022] DELETE /identity/v3/projects/b8127b2d6db44e61a7ab7c9cfa357481 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:58.214624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:58.216457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.295932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16cb5e-b9a3-4e32-b182-88cf6a61f6a6 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:58.348111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5ce6b-8162-42bb-b019-4fce6802c496 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:58.355022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:58.356748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.357246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.357913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] PATH_INFO: `/v3/users/7c8c5b9c982746a1aebb97274702dbb0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.359983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8c5b9c982746a1aebb97274702dbb0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:58.362295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:58.429493 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18716b6-8f8d-43e1-ac58-6695dca50052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:58.430254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716b6-8f8d-43e1-ac58-6695dca50052 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.431001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716b6-8f8d-43e1-ac58-6695dca50052 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.442452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716b6-8f8d-43e1-ac58-6695dca50052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.444600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e18716b6-8f8d-43e1-ac58-6695dca50052 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.452806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8c5b9c982746a1aebb97274702dbb0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.467499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8c5b9c982746a1aebb97274702dbb0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.468625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8c5b9c982746a1aebb97274702dbb0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.469508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8c5b9c982746a1aebb97274702dbb0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.478330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8c5b9c982746a1aebb97274702dbb0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.505506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 987/1975] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:58 2022] DELETE /identity/v3/users/7c8c5b9c982746a1aebb97274702dbb0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:58.518740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18716b6-8f8d-43e1-ac58-6695dca50052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:58.520431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18716b6-8f8d-43e1-ac58-6695dca50052 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:58.530702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 989/1976] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:58 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:58.545251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:58.546878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.629518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96af85-16a9-4baf-9f5f-0ac0f7a23821 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:58.635021 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:58.636540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.636540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.636779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] PATH_INFO: `/v3/users/62a16348b5534562adf192ca1fccc626` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.638820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a16348b5534562adf192ca1fccc626)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:58.640884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:58.708844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a16348b5534562adf192ca1fccc626'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.717051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a16348b5534562adf192ca1fccc626'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.718503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a16348b5534562adf192ca1fccc626'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.719630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a16348b5534562adf192ca1fccc626'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.732669 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a16348b5534562adf192ca1fccc626'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.762925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 988/1977] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:58 2022] DELETE /identity/v3/users/62a16348b5534562adf192ca1fccc626 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:58.767639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.767973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.768259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.786969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:58.788208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.839554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:58.841048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.897356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 990/1978] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:58.907267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:58.908881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.921782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152273-9e42-496d-8583-3269bd0d1882 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:58.927198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:58.928148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.928331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.928602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] PATH_INFO: `/v3/projects/4e975cfe45034a1595dbebec84a379ce` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.929811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e975cfe45034a1595dbebec84a379ce)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:58.932248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:58.973870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8410-f4ed-4446-bb8b-deb1f8acc2d9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:58.980132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d552e9-3cce-4145-81e1-b0886fec1f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:58.980848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d552e9-3cce-4145-81e1-b0886fec1f00 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.981039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d552e9-3cce-4145-81e1-b0886fec1f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.981496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d552e9-3cce-4145-81e1-b0886fec1f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.991022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e975cfe45034a1595dbebec84a379ce', 'request_id': 'req-a0eb74eb-78e1-4da1-877c-59466a977cf7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:58.992161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d552e9-3cce-4145-81e1-b0886fec1f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:58.994575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d552e9-3cce-4145-81e1-b0886fec1f00 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:58.996930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e975cfe45034a1595dbebec84a379ce', 'request_id': 'req-a0eb74eb-78e1-4da1-877c-59466a977cf7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.005977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 991/1979] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:06:59.006250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e975cfe45034a1595dbebec84a379ce', 'request_id': 'req-a0eb74eb-78e1-4da1-877c-59466a977cf7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.017939 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] The token cache is being invalidate because project 4e975cfe45034a1595dbebec84a379ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:59.018314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.018991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a0eb74eb-78e1-4da1-877c-59466a977cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.020831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 989/1980] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:58 2022] DELETE /identity/v3/projects/4e975cfe45034a1595dbebec84a379ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:59.028196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e3a4a-4a45-43e3-8e4b-50b22527f4fb None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.028883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e3a4a-4a45-43e3-8e4b-50b22527f4fb None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.029401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e3a4a-4a45-43e3-8e4b-50b22527f4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.067617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6f5e3a4a-4a45-43e3-8e4b-50b22527f4fb None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:59.069764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6f5e3a4a-4a45-43e3-8e4b-50b22527f4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:59.178689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36864ae-fc34-4777-980c-520e5aac04cf None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.178976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36864ae-fc34-4777-980c-520e5aac04cf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.179254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36864ae-fc34-4777-980c-520e5aac04cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.189655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 992/1981] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:59.220513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d36864ae-fc34-4777-980c-520e5aac04cf None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:59.223051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d36864ae-fc34-4777-980c-520e5aac04cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:59.242821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 990/1982] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:59.245065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e3a4a-4a45-43e3-8e4b-50b22527f4fb None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.266793 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e3a4a-4a45-43e3-8e4b-50b22527f4fb None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.278175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.278905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.279168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.279444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.280190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:06:59.280474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.282251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.298378 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 993/1983] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:06:59.303461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36864ae-fc34-4777-980c-520e5aac04cf None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.314452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36864ae-fc34-4777-980c-520e5aac04cf None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.320322 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.321143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.321848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.322269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.323279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.326563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.370780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 991/1984] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:06:59 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:59.377671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.394549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4361c-ecbb-4c5c-8bce-8ccff8711638 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.465737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.469223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:59.511748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.513174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.513657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.514027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.515871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.522393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.552222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 994/1985] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:06:59 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:06:59.556325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.569744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc59361-b7bb-41e3-bc95-be0e324e3619 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.578279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.579027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.579401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.579711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.580434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.582202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.583515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefb11c-3216-4b2c-b6ef-12be3a65a37a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.591283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.592341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.592622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.592900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] PATH_INFO: `/v3/projects/23a544cf9e75426dbc7004bf9249bc5a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.594184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a544cf9e75426dbc7004bf9249bc5a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.596097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.599794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 995/1986] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:59.606340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.629599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b33af-a55e-4304-9121-21e0e21bbe02 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.640186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.641415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.641415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.641902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.642929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.644742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.658115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 996/1987] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:06:59.662442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a544cf9e75426dbc7004bf9249bc5a', 'request_id': 'req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.663264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.672089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a544cf9e75426dbc7004bf9249bc5a', 'request_id': 'req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.683125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377bc6-5dfc-4081-a3ec-f267f3ef79ac admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.687225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a544cf9e75426dbc7004bf9249bc5a', 'request_id': 'req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.702914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] The token cache is being invalidate because project 23a544cf9e75426dbc7004bf9249bc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:59.704315 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.705155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fdacac9f-9844-4a6b-97f7-b42a5f2066d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:59.707049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 992/1988] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:06:59 2022] DELETE /identity/v3/projects/23a544cf9e75426dbc7004bf9249bc5a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:59.712991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.713446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.713805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.748304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:59.750350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:59.818938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c6da2-6e80-4c3a-aa0b-d89567d60d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.819987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6da2-6e80-4c3a-aa0b-d89567d60d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.820486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6da2-6e80-4c3a-aa0b-d89567d60d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.820996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6da2-6e80-4c3a-aa0b-d89567d60d02 admin admin] PATH_INFO: `/v3/projects/dc197b252251480e8663f06a2e1faf35/users/2d9bd7a6ff3d467d886d66b3968f10fc/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.840176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c6da2-6e80-4c3a-aa0b-d89567d60d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc197b252251480e8663f06a2e1faf35, user_id=2d9bd7a6ff3d467d886d66b3968f10fc, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.843059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c6da2-6e80-4c3a-aa0b-d89567d60d02 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.844927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 993/1989] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:59.845901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:59.847369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:59.859353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 997/1990] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:06:59 2022] PUT /identity/v3/projects/dc197b252251480e8663f06a2e1faf35/users/2d9bd7a6ff3d467d886d66b3968f10fc/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:06:59.860640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95625ccf-31e2-40b1-9672-160acb90d7de None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:59.863377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098b11-c8dc-4317-b7fe-cd65f92fe3fd None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.863813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098b11-c8dc-4317-b7fe-cd65f92fe3fd None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.864944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098b11-c8dc-4317-b7fe-cd65f92fe3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.887523 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-35098b11-c8dc-4317-b7fe-cd65f92fe3fd None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:59.888728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-35098b11-c8dc-4317-b7fe-cd65f92fe3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:59.917694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:59.918648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.918928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.919196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] PATH_INFO: `/v3/users/26a6644db0714b8fbfaf5339d179ea16` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.920363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a6644db0714b8fbfaf5339d179ea16)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:59.922297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:59.954543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 998/1991] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:59.959016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94058-31e3-4df8-9650-2f080a515001 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:59.959324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94058-31e3-4df8-9650-2f080a515001 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:59.959590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94058-31e3-4df8-9650-2f080a515001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:59.995506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a6644db0714b8fbfaf5339d179ea16'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:00.008138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a6644db0714b8fbfaf5339d179ea16'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:00.008883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a6644db0714b8fbfaf5339d179ea16'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:00.010252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a6644db0714b8fbfaf5339d179ea16'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:00.011209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1cd94058-31e3-4df8-9650-2f080a515001 None None] MFA Rules not processed for user `2d9bd7a6ff3d467d886d66b3968f10fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:00.014175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1cd94058-31e3-4df8-9650-2f080a515001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:00.020224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a6644db0714b8fbfaf5339d179ea16'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:00.047671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 994/1992] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:06:59 2022] DELETE /identity/v3/users/26a6644db0714b8fbfaf5339d179ea16 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:00.052187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.053550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:00.112770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 999/1993] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:06:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:00.114074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.114367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.114804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.133885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:00.135830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:00.144749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1000/1994] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:00.145969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.147289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:00.154659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939eda-23bf-480c-944f-29c9d8da49d0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.165192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.166504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.166976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.168146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.169992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:00.170550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.173561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.189796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 995/1995] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:00.190563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.193133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:00.210446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6218ea-780e-40c9-9a55-079e961be35d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.214902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.215566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.216011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.216698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.285748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.287336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.287640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69ce4-1cf3-416d-b487-5df71ba962de admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.291262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.291904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.292178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.292810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.297550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1001/1996] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:00.298350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.312072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c192a-b952-40fb-bcf8-b12663012e0a service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.312344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.313904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.318200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.319141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.319470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.320521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.321397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.324945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.326389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 996/1997] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:00.355467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1002/1998] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:00 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:00.359544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.374351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65215deb-c690-405e-92d0-dca3ae7385c7 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.463348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.464520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.464648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.465215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.466412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.469833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.495247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 997/1999] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:00 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:00.500722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.513496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b240-b5b4-4469-9c24-097b49202453 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.519544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.520743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.521299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.521712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.522561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.525057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.573088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1003/2000] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:00.574344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.591045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d95217-b08e-4943-9d51-639d2edc166b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.609755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a74388-a048-41f6-abe3-c6f785f04267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.610540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74388-a048-41f6-abe3-c6f785f04267 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.610876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74388-a048-41f6-abe3-c6f785f04267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.612715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74388-a048-41f6-abe3-c6f785f04267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.613913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74388-a048-41f6-abe3-c6f785f04267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.621680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74388-a048-41f6-abe3-c6f785f04267 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.643933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 998/2001] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:00.648160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.676233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd04eb-3093-41da-bb3a-1e7703179359 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.704580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.707425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.707707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.708024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] PATH_INFO: `/v3/projects/3b9a8ec163fd414293e023d806fa8b03/users/a54e86eb6a914329bb9508e4d5ae52f3/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.742453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9a8ec163fd414293e023d806fa8b03, user_id=a54e86eb6a914329bb9508e4d5ae52f3, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.746865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.771165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1004/2002] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:00 2022] PUT /identity/v3/projects/3b9a8ec163fd414293e023d806fa8b03/users/a54e86eb6a914329bb9508e4d5ae52f3/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:00.784049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339530cc-b2da-4945-94ad-d648383d92ff None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.784851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339530cc-b2da-4945-94ad-d648383d92ff None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.785304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339530cc-b2da-4945-94ad-d648383d92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.820306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-339530cc-b2da-4945-94ad-d648383d92ff None None] MFA Rules not processed for user `a54e86eb6a914329bb9508e4d5ae52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:00.821540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-339530cc-b2da-4945-94ad-d648383d92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:00.838543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.841310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:00.918493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 999/2003] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:00.924673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339530cc-b2da-4945-94ad-d648383d92ff None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:00.937329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339530cc-b2da-4945-94ad-d648383d92ff None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.939015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf57b8-08c6-4cf2-943f-ae15a6c2c46c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:00.944489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.945277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:00.945972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.946191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:00.946671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.946921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:00.947242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.947496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] PATH_INFO: `/v3/users/f5753a6c5bf64dae8e644f9e7ddbfe30` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:00.948070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.949066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5753a6c5bf64dae8e644f9e7ddbfe30)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:00.951521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.951633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:00.994304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1000/2004] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:00 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:00.999688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.024370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5753a6c5bf64dae8e644f9e7ddbfe30'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.035143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5753a6c5bf64dae8e644f9e7ddbfe30'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.036194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5753a6c5bf64dae8e644f9e7ddbfe30'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.046005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5753a6c5bf64dae8e644f9e7ddbfe30'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.050270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9f07523a-dda4-4ff8-a61f-821744889a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5753a6c5bf64dae8e644f9e7ddbfe30'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.080484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1005/2005] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:00 2022] DELETE /identity/v3/users/f5753a6c5bf64dae8e644f9e7ddbfe30 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:01.083037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.083535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.083969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.098030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2038a5-8db2-434a-90c6-b09fdb47ccd4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.120913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:01.122531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.172676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.173388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.174255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.174255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.175213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.177088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.199467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1001/2006] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:00 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:01.205700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1006/2007] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:01.208193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.210216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.218638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.223601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fd3a0-b9d0-43af-bc08-4c629be2effe admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.224544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.231918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.232652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.233003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.233349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.234170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.235828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.252018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1002/2008] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:01.253097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.257044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.273642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da88cc-814c-464b-9076-a8e69b728913 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.281373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.282379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.282719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.283081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] PATH_INFO: `/v3/projects/f03776e5558c4b54b79922fe8a41842b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.284327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03776e5558c4b54b79922fe8a41842b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.286338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.289684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5df86-ce4c-48a6-ad39-4f6c318040be None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.293796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.294615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.295048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.295820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.305329 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.306820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.317755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1007/2009] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:01.318598 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.328156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa7dd-0ad6-40ab-b9c5-54fcf1c01bf3 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.341759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03776e5558c4b54b79922fe8a41842b', 'request_id': 'req-8274f6e3-b56c-4200-8539-93bb4da96246'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.352364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03776e5558c4b54b79922fe8a41842b', 'request_id': 'req-8274f6e3-b56c-4200-8539-93bb4da96246'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.364422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03776e5558c4b54b79922fe8a41842b', 'request_id': 'req-8274f6e3-b56c-4200-8539-93bb4da96246'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.385525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] The token cache is being invalidate because project f03776e5558c4b54b79922fe8a41842b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:01.386259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.386682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.388738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1003/2010] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:01 2022] DELETE /identity/v3/projects/f03776e5558c4b54b79922fe8a41842b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:01.393432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.397146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.430545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.431769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.432159 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.433256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.434995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.437566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.452905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1008/2011] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:01.457551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.460601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.489937 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898c98-679a-4c28-b1a5-1ba5506fa9c6 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.494947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e8c74-da43-4a45-ae2e-b42594da77d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.495860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8c74-da43-4a45-ae2e-b42594da77d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.496144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8c74-da43-4a45-ae2e-b42594da77d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.496423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8c74-da43-4a45-ae2e-b42594da77d0 admin admin] PATH_INFO: `/v3/projects/bec1939a65384d9e8cbf5e92a4a6b98b/users/a11c53b5525444d3961453dcb4058de1/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.501249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274f6e3-b56c-4200-8539-93bb4da96246 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.508236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.509925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.510377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.510788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] PATH_INFO: `/v3/users/94ff341b6c954d82bce9c6d15ccc096d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.512194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ff341b6c954d82bce9c6d15ccc096d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.514349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.526605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8c74-da43-4a45-ae2e-b42594da77d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec1939a65384d9e8cbf5e92a4a6b98b, user_id=a11c53b5525444d3961453dcb4058de1, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.530436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8c74-da43-4a45-ae2e-b42594da77d0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.552752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1009/2012] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:01 2022] PUT /identity/v3/projects/bec1939a65384d9e8cbf5e92a4a6b98b/users/a11c53b5525444d3961453dcb4058de1/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:01.565702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.566161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.566607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.593988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ff341b6c954d82bce9c6d15ccc096d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.604608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ff341b6c954d82bce9c6d15ccc096d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.605682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] MFA Rules not processed for user `a11c53b5525444d3961453dcb4058de1`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:01.605833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ff341b6c954d82bce9c6d15ccc096d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.606484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ff341b6c954d82bce9c6d15ccc096d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.607463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.627080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ff341b6c954d82bce9c6d15ccc096d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.656460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1004/2013] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:01 2022] DELETE /identity/v3/users/94ff341b6c954d82bce9c6d15ccc096d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:01.663434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.664874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.725363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1010/2014] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:01.729734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.731183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.756793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab9e81-55ec-4a45-97b6-be8ad5a5ca9b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.763708 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.764964 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.765323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.765812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] PATH_INFO: `/v3/projects/028a5718bd24406691f4b34cbe34cd0c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.768651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028a5718bd24406691f4b34cbe34cd0c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.770810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.826675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890648f-5c4d-4214-963e-385fa2eff1f5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:01.831763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028a5718bd24406691f4b34cbe34cd0c', 'request_id': 'req-af5927ad-e54a-442e-9406-2443c1079bd7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.840080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028a5718bd24406691f4b34cbe34cd0c', 'request_id': 'req-af5927ad-e54a-442e-9406-2443c1079bd7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.849457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028a5718bd24406691f4b34cbe34cd0c', 'request_id': 'req-af5927ad-e54a-442e-9406-2443c1079bd7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.863083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] The token cache is being invalidate because project 028a5718bd24406691f4b34cbe34cd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:01.863495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.864331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:01.869515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1005/2015] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:01 2022] DELETE /identity/v3/projects/028a5718bd24406691f4b34cbe34cd0c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:01.873250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.874729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:01.905687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:01.906672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:01.907077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:01.907610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:01.908380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:01.910924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:01.989416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1011/2016] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:01 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:01.990856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:01.992779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:02.041629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5927ad-e54a-442e-9406-2443c1079bd7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.108919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a643f-3921-47b5-b33c-d47380ce6c8d admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.114174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.115155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.115318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.115740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.116714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.119842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.165228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1012/2017] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:01 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:02.170404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.170808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:02.171594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.171873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.172208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] PATH_INFO: `/v3/users/5997a3f55d594472baca59013cc5ece7` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.173819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5997a3f55d594472baca59013cc5ece7)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.175969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.182965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645337b-3355-4d84-9214-e1025989e90f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.188501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.189275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.189679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.190124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.191170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.192971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.204513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1013/2018] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:07:02.210944 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:02.233712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3056fd-3c7e-459c-a6d9-4c2d72811dba admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.241041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.242220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.242600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.242970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] PATH_INFO: `/v3/projects/88c0fa6b52cd4fae92b609546b25af69/users/5b536df9154646f98c130b75a75bcd21/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.283072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c0fa6b52cd4fae92b609546b25af69, user_id=5b536df9154646f98c130b75a75bcd21, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.283746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5997a3f55d594472baca59013cc5ece7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.289140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.303011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5997a3f55d594472baca59013cc5ece7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.304343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5997a3f55d594472baca59013cc5ece7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.306564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5997a3f55d594472baca59013cc5ece7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.322061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5997a3f55d594472baca59013cc5ece7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.329645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1014/2019] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:02 2022] PUT /identity/v3/projects/88c0fa6b52cd4fae92b609546b25af69/users/5b536df9154646f98c130b75a75bcd21/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:02.330672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:02.335221 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:02.350263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1006/2020] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:01 2022] DELETE /identity/v3/users/5997a3f55d594472baca59013cc5ece7 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:02.425341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04544425-be99-4373-bd60-d184219522c7 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.501691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:02.503311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:02.575864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.577578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.578015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.578442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.579462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.581555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.595127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1015/2021] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:02.600181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:02.615056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3509-88c4-4ac4-a9ba-1c31b300719c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.622841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509a858-8a10-4ac1-a84e-86c97c1447c8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.624752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00e5a2-e142-4d72-94e7-0ab0b5e02b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.626252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e5a2-e142-4d72-94e7-0ab0b5e02b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.626773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e5a2-e142-4d72-94e7-0ab0b5e02b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.627377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e5a2-e142-4d72-94e7-0ab0b5e02b36 admin admin] PATH_INFO: `/v3/projects/88c0fa6b52cd4fae92b609546b25af69/users/5b536df9154646f98c130b75a75bcd21/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.628148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.629319 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.629697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.630052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] PATH_INFO: `/v3/projects/a1f2cba001554ad89c62230d68d0de13` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.631376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f2cba001554ad89c62230d68d0de13)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.631664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00e5a2-e142-4d72-94e7-0ab0b5e02b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c0fa6b52cd4fae92b609546b25af69, user_id=5b536df9154646f98c130b75a75bcd21, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.633501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.635999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00e5a2-e142-4d72-94e7-0ab0b5e02b36 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.663628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1016/2022] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:02 2022] PUT /identity/v3/projects/88c0fa6b52cd4fae92b609546b25af69/users/5b536df9154646f98c130b75a75bcd21/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:02.666416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.666700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.669934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.701914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f2cba001554ad89c62230d68d0de13', 'request_id': 'req-fd7c41d2-a457-4161-b87c-deee9760a215'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.707588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f2cba001554ad89c62230d68d0de13', 'request_id': 'req-fd7c41d2-a457-4161-b87c-deee9760a215'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.718453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f2cba001554ad89c62230d68d0de13', 'request_id': 'req-fd7c41d2-a457-4161-b87c-deee9760a215'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.719650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] MFA Rules not processed for user `5b536df9154646f98c130b75a75bcd21`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:02.720858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:02.748094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] The token cache is being invalidate because project a1f2cba001554ad89c62230d68d0de13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:02.748277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.748948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fd7c41d2-a457-4161-b87c-deee9760a215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:02.752132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1007/2023] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:02 2022] DELETE /identity/v3/projects/a1f2cba001554ad89c62230d68d0de13 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:02.760146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.760600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.761086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.784796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:02.786610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:02.834789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1017/2024] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:02.843488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:02.847188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:02.907805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1008/2025] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:02.908680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:02.915787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:02.936993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad762f-c596-4639-8608-9c12e6050964 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.945815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.948520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.949571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.950044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] PATH_INFO: `/v3/projects/c050a76432374dd0b40ca89e36053330` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.952250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c050a76432374dd0b40ca89e36053330)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:02.955092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:02.961404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21223d-c748-4704-bcc6-47bc27409545 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:02.966589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2564aa-b3d0-46e0-80d5-a604effb6e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:02.967241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2564aa-b3d0-46e0-80d5-a604effb6e82 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:02.967734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2564aa-b3d0-46e0-80d5-a604effb6e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:02.968166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2564aa-b3d0-46e0-80d5-a604effb6e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:02.970352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1a2564aa-b3d0-46e0-80d5-a604effb6e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:03.048016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c050a76432374dd0b40ca89e36053330', 'request_id': 'req-969a47fb-fbb3-4a65-80ea-53c14f94eeef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:03.060210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c050a76432374dd0b40ca89e36053330', 'request_id': 'req-969a47fb-fbb3-4a65-80ea-53c14f94eeef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:03.074512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c050a76432374dd0b40ca89e36053330', 'request_id': 'req-969a47fb-fbb3-4a65-80ea-53c14f94eeef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:03.088822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2564aa-b3d0-46e0-80d5-a604effb6e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.090468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2564aa-b3d0-46e0-80d5-a604effb6e82 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.096703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] The token cache is being invalidate because project c050a76432374dd0b40ca89e36053330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:03.097205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:03.098325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-969a47fb-fbb3-4a65-80ea-53c14f94eeef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:03.101510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1009/2026] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:02 2022] DELETE /identity/v3/projects/c050a76432374dd0b40ca89e36053330 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:03.104974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5350f5-0a55-4332-b4b0-9ea6d82d1eb7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.105257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5350f5-0a55-4332-b4b0-9ea6d82d1eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.105555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5350f5-0a55-4332-b4b0-9ea6d82d1eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.117614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1018/2027] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:03.119548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1f29d-a277-4ace-a84b-8ed2c8a65392 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.119837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1f29d-a277-4ace-a84b-8ed2c8a65392 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.120109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1f29d-a277-4ace-a84b-8ed2c8a65392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.125043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0c5350f5-0a55-4332-b4b0-9ea6d82d1eb7 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:03.126264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0c5350f5-0a55-4332-b4b0-9ea6d82d1eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:03.145542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-79e1f29d-a277-4ace-a84b-8ed2c8a65392 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:03.147017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-79e1f29d-a277-4ace-a84b-8ed2c8a65392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:03.205698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1010/2028] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:03.210111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5350f5-0a55-4332-b4b0-9ea6d82d1eb7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.212729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1019/2029] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:03.221044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafc37-dcaa-4919-bc6e-efe881aefe6a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.221547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafc37-dcaa-4919-bc6e-efe881aefe6a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.221960 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafc37-dcaa-4919-bc6e-efe881aefe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.224276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5350f5-0a55-4332-b4b0-9ea6d82d1eb7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.230840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.231846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.232223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.232567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.233998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:03.234318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.236513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.244130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-52cafc37-dcaa-4919-bc6e-efe881aefe6a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:03.245703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-52cafc37-dcaa-4919-bc6e-efe881aefe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:03.255317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1020/2030] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:03.255885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1011/2031] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:03.263567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafc37-dcaa-4919-bc6e-efe881aefe6a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.266139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.277993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafc37-dcaa-4919-bc6e-efe881aefe6a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.279558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eacf4-d843-47f5-9202-aeaeb38d8af2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.285111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.286110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.286521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.286831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.287325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.287543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.287642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.287976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.288952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.289202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:03.289808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.291792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.292172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.309519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1021/2032] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:03.311154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.322892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73af73-b9dc-4872-9dae-339024b1fa0a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.328292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.328959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.329242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.329534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.329801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1012/2033] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:03.330273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.332533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.334139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.363306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1022/2034] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:03.367441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.435019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933de773-b4e0-4243-a463-a190d85fa29d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.449785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d92929-cb45-4d31-88e5-285585084a08 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.457179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.457898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.458176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.458684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.459141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.461048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.494553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1023/2035] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:03.495488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.511693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335c953-b893-4acd-85d5-ff7f045afc9d admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.517840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.519231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.519536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.519901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.520790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.522593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.522831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.523653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.524066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.524406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.525397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.527848 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.540759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1024/2036] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:03.543577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.554400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630e2f6-43c2-4da3-b8a4-033088d6f779 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.557615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1013/2037] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:03.560265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.560949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.561232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.561529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.562262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.562421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.564031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.577424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1025/2038] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:03.577967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c8f53-2191-40ad-a55f-eca5f4abf3ae admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.582269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.588625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.589628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.590291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.590875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.592398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.594650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.595307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a2dbf-38db-4c7f-a4ac-b43c3438beed admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.600728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc65fc-4805-4d75-8cfb-7e298973f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.601759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc65fc-4805-4d75-8cfb-7e298973f873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.602126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc65fc-4805-4d75-8cfb-7e298973f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.602572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc65fc-4805-4d75-8cfb-7e298973f873 admin admin] PATH_INFO: `/v3/projects/3e5ea9f658ed467a92cf45d7f775a6da/users/0a293358838f45e4b4ae59ee3b1ca28d/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.607367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1014/2039] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:07:03.611597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.622407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7c4d-e88a-4aed-9922-54cbfb097671 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.626873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc65fc-4805-4d75-8cfb-7e298973f873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5ea9f658ed467a92cf45d7f775a6da, user_id=0a293358838f45e4b4ae59ee3b1ca28d, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.627444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.628364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.628746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.629117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.629588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc65fc-4805-4d75-8cfb-7e298973f873 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.630212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.631858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.645353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1015/2040] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:07:03.646667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1026/2041] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:03 2022] PUT /identity/v3/projects/3e5ea9f658ed467a92cf45d7f775a6da/users/0a293358838f45e4b4ae59ee3b1ca28d/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:03.649938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.656762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53521a-ee3e-4f0e-8216-e55f9e08e3a7 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.657099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53521a-ee3e-4f0e-8216-e55f9e08e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.657381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53521a-ee3e-4f0e-8216-e55f9e08e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.660368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b443e-a77e-493a-847b-5a86c8c17414 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.700808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-bc53521a-ee3e-4f0e-8216-e55f9e08e3a7 None None] MFA Rules not processed for user `0a293358838f45e4b4ae59ee3b1ca28d`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:03.702077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bc53521a-ee3e-4f0e-8216-e55f9e08e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:03.739638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.741498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.741787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.742498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] PATH_INFO: `/v3/projects/9a526aa99f1d4cbda826156de52c676d/users/cec3a641a09648d79bd8569db97557a9/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.765974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a526aa99f1d4cbda826156de52c676d, user_id=cec3a641a09648d79bd8569db97557a9, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.769819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.784192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1016/2042] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:03 2022] PUT /identity/v3/projects/9a526aa99f1d4cbda826156de52c676d/users/cec3a641a09648d79bd8569db97557a9/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:03.784897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1027/2043] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:03.790092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.796693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.796978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.797373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.824959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] MFA Rules not processed for user `cec3a641a09648d79bd8569db97557a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:03.826273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:03.875422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1a078-c972-4e8c-9c79-8b71ae875049 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:03.882721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:03.883379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:03.883656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:03.883928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:03.884640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:03.886602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:03.900381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1028/2044] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:03.910894 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.912383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:03.920340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1017/2045] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:03.921265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:03.979608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3d09e-c4b4-477f-b9cd-bd2f68010ba1 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:04.000863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f1f9f-10ca-47cb-977f-a788fc3746b7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:04.005637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:04.006318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.006600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.007049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.007738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:04.009844 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:04.033768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9c380955a04c24af2823e22fe3ec70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:04.034515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.034857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.035192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.036585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1018/2046] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:03 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:04.037739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:04.049049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f5513-4da5-4593-907c-47de5fdd66b3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:04.054026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:04.054809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.055092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.055363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.056339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:04.057894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:04.068300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1019/2047] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:04.072194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:04.082460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05da6-8816-40e5-aa44-edd407f814ba admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:04.088396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:04.089367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.089758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.090029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] PATH_INFO: `/v3/projects/d3a96c71f3d746e4a0cd5e12e13c4e77/users/8e3dfe2bbb634bd59abc7afba225583a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.098499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:04.100685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:04.106097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a96c71f3d746e4a0cd5e12e13c4e77, user_id=8e3dfe2bbb634bd59abc7afba225583a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:04.108751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:04.113649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1029/2048] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:04.124522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1020/2049] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:04 2022] PUT /identity/v3/projects/d3a96c71f3d746e4a0cd5e12e13c4e77/users/8e3dfe2bbb634bd59abc7afba225583a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:04.128156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:04.139285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da620359-2123-4ac0-ae57-dce00f9482f0 service glance] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:04.219466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae92206-fcd8-4140-9506-ae0565f436d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:04.220094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae92206-fcd8-4140-9506-ae0565f436d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.220380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae92206-fcd8-4140-9506-ae0565f436d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.220654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae92206-fcd8-4140-9506-ae0565f436d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.221375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae92206-fcd8-4140-9506-ae0565f436d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:04.223008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae92206-fcd8-4140-9506-ae0565f436d0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:04.234943 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1030/2050] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:04.239351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:04.252179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db415e1-66f4-452f-878f-12567e2c79a5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:04.258758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:04.260251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.260731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.261052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] PATH_INFO: `/v3/projects/d3a96c71f3d746e4a0cd5e12e13c4e77/users/8e3dfe2bbb634bd59abc7afba225583a/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.263765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a96c71f3d746e4a0cd5e12e13c4e77, user_id=8e3dfe2bbb634bd59abc7afba225583a, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:04.266828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:04.280124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1021/2051] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:04 2022] PUT /identity/v3/projects/d3a96c71f3d746e4a0cd5e12e13c4e77/users/8e3dfe2bbb634bd59abc7afba225583a/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:04.290589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb65d-82c2-46ed-b6e3-a78d7b7f8615 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.291100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb65d-82c2-46ed-b6e3-a78d7b7f8615 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.291552 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb65d-82c2-46ed-b6e3-a78d7b7f8615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.323338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ec3eb65d-82c2-46ed-b6e3-a78d7b7f8615 None None] MFA Rules not processed for user `8e3dfe2bbb634bd59abc7afba225583a`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:04.326545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ec3eb65d-82c2-46ed-b6e3-a78d7b7f8615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:04.409502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1031/2052] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:04.419829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:04.422009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:04.488849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5b87a-c03a-4e9c-90ba-48f248fe82c5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:04.494650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:04.495397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:04.495904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:04.496317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:04.560778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:04.562503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:04.579678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1022/2053] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:05.865543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eb65d-82c2-46ed-b6e3-a78d7b7f8615 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:05.875218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eb65d-82c2-46ed-b6e3-a78d7b7f8615 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:05.879407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:05.880046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:05.880420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:05.880706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:05.882677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:05.940700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:05.942154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:05.953351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1032/2054] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:06.547608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:06.549244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:06.560451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6e69c-3e7c-4d7b-a157-12193132a8bc service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:06.564401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7651d-07d2-4c79-b63c-d183b0af432d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:06.565042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7651d-07d2-4c79-b63c-d183b0af432d service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:06.565361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7651d-07d2-4c79-b63c-d183b0af432d service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:06.565658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7651d-07d2-4c79-b63c-d183b0af432d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:06.567373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cda7651d-07d2-4c79-b63c-d183b0af432d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:06.636514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7651d-07d2-4c79-b63c-d183b0af432d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:06.638195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7651d-07d2-4c79-b63c-d183b0af432d service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:06.652545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1023/2055] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:08.984906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:08.986411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.050608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ba48-ee57-4d6c-b495-c6ced7a00165 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:09.055130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:09.056616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.056901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.057175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] PATH_INFO: `/v3/users/2d9bd7a6ff3d467d886d66b3968f10fc` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.058395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9bd7a6ff3d467d886d66b3968f10fc)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:09.060314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:09.117163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9bd7a6ff3d467d886d66b3968f10fc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.126139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9bd7a6ff3d467d886d66b3968f10fc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.126841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9bd7a6ff3d467d886d66b3968f10fc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.138956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9bd7a6ff3d467d886d66b3968f10fc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.139705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9bd7a6ff3d467d886d66b3968f10fc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.159705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1033/2056] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:08 2022] DELETE /identity/v3/users/2d9bd7a6ff3d467d886d66b3968f10fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:09.164173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.164670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.164755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.184083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:09.185276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.259768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1024/2057] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:09.270582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:09.272204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.351362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ea99-15ce-4ff3-afef-9c80bea221a1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:09.355799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d8f52-b268-4f27-871e-6e65376c6ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:09.356812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d8f52-b268-4f27-871e-6e65376c6ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.356812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d8f52-b268-4f27-871e-6e65376c6ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.357011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d8f52-b268-4f27-871e-6e65376c6ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.369704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d8f52-b268-4f27-871e-6e65376c6ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:09.369704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d8f52-b268-4f27-871e-6e65376c6ee7 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:09.391609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1034/2058] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:09.699956 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:09.701571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.713654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4450ead-1f97-4945-b6d5-f0e49d3d2233 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:09.718219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:09.719065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.719341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.719614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] PATH_INFO: `/v3/projects/dc197b252251480e8663f06a2e1faf35` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.720866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc197b252251480e8663f06a2e1faf35)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:09.722857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:09.769899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc197b252251480e8663f06a2e1faf35', 'request_id': 'req-27520b24-fe36-4c40-a134-5ae887d7b6d0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.775748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc197b252251480e8663f06a2e1faf35', 'request_id': 'req-27520b24-fe36-4c40-a134-5ae887d7b6d0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.783641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc197b252251480e8663f06a2e1faf35', 'request_id': 'req-27520b24-fe36-4c40-a134-5ae887d7b6d0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.796305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] The token cache is being invalidate because project dc197b252251480e8663f06a2e1faf35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:09.796586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.797239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:09.799148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1025/2059] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:09 2022] DELETE /identity/v3/projects/dc197b252251480e8663f06a2e1faf35 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:09.803760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe390a-7132-4435-b0c3-09d132053857 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.804072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe390a-7132-4435-b0c3-09d132053857 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.804405 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe390a-7132-4435-b0c3-09d132053857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.823581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5bbe390a-7132-4435-b0c3-09d132053857 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:09.824861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5bbe390a-7132-4435-b0c3-09d132053857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.866797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:09.868758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.891183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1035/2060] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:09.899149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264ff9-2024-487f-b583-865ce38b278f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.899377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264ff9-2024-487f-b583-865ce38b278f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.899971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264ff9-2024-487f-b583-865ce38b278f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.923457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0b264ff9-2024-487f-b583-865ce38b278f None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:09.924993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0b264ff9-2024-487f-b583-865ce38b278f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.929002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520b24-fe36-4c40-a134-5ae887d7b6d0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:09.934339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:09.935046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.935821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.935821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.936387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1036/2061] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:09.940825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b264ff9-2024-487f-b583-865ce38b278f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:09.941498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:09.951858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b264ff9-2024-487f-b583-865ce38b278f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:09.956896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:09.957775 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.958178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.958560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.959389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:09.959802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:09.961514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:09.978421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1037/2062] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:07:09.979632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:09.989980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015a45-3e9d-49c1-b9b0-2efa3574b6db admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:09.995200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:09.995848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:09.996131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:09.996429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:09.997100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:09.999023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.013435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.015038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.026061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1026/2063] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:10.029862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1038/2064] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:09 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:10.030985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:10.041044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20756e8-b324-4884-8620-ff4b992d1d83 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:10.097557 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:10.098136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.098413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.098712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.099390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.101427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.122958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1027/2065] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:10 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:10.127274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:10.138953 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdc4a-ae90-482a-86c0-554db6af9780 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:10.144082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:10.144776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.145021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.145290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.146924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.147713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.158212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1039/2066] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:10.162334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:10.173458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c0148-5020-4a08-bb6e-38496f09f032 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:10.179637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05733784-bbea-4a62-82dc-2e7589d26541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:10.181607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733784-bbea-4a62-82dc-2e7589d26541 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.182058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733784-bbea-4a62-82dc-2e7589d26541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.182746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733784-bbea-4a62-82dc-2e7589d26541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.183666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05733784-bbea-4a62-82dc-2e7589d26541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.185673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05733784-bbea-4a62-82dc-2e7589d26541 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.197950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1028/2067] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:10.202558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:10.212516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349b684-6ad8-4d64-86b1-f4c1c34ef370 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:10.218275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:10.219177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.219462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.219738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] PATH_INFO: `/v3/projects/af9b6b63b0214c8691eaaafd8854052b/users/49cdd42c77604895b17a909f5913563c/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.239722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9b6b63b0214c8691eaaafd8854052b, user_id=49cdd42c77604895b17a909f5913563c, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.244542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.265981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1040/2068] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:10 2022] PUT /identity/v3/projects/af9b6b63b0214c8691eaaafd8854052b/users/49cdd42c77604895b17a909f5913563c/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:10.279581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.280134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.280555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.317347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] MFA Rules not processed for user `49cdd42c77604895b17a909f5913563c`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:10.320200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:10.394256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1029/2069] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:10.406431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:10.462364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9dfa5-136e-4aad-a377-a9c90b233bee admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:10.466217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa546f-f1f0-4a62-9989-69d59d4c96b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:10.466850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa546f-f1f0-4a62-9989-69d59d4c96b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.467126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa546f-f1f0-4a62-9989-69d59d4c96b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.467392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa546f-f1f0-4a62-9989-69d59d4c96b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.475406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa546f-f1f0-4a62-9989-69d59d4c96b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.476810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa546f-f1f0-4a62-9989-69d59d4c96b6 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.485803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1041/2070] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:10.590823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:10.592215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:10.660455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66054d92-0cf9-42ce-b782-336a18fdcef7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:10.666140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:10.667165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.667528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.667875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] PATH_INFO: `/v3/users/a54e86eb6a914329bb9508e4d5ae52f3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.669178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54e86eb6a914329bb9508e4d5ae52f3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.671507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.724259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54e86eb6a914329bb9508e4d5ae52f3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:10.734283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54e86eb6a914329bb9508e4d5ae52f3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:10.735394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54e86eb6a914329bb9508e4d5ae52f3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:10.736383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54e86eb6a914329bb9508e4d5ae52f3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:10.748764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54e86eb6a914329bb9508e4d5ae52f3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:10.778199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1030/2071] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:10 2022] DELETE /identity/v3/users/a54e86eb6a914329bb9508e4d5ae52f3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:10.783155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.783700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.784208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.813206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:10.814583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:10.877470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1042/2072] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:10.887513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:10.889063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:10.947524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df495c66-0529-4f87-b9b5-e95ebec4fb5a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:10.951037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:10.951674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:10.951952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:10.952225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:10.961133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:10.963047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:10.973955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1031/2073] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:11.236451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:11.237984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:11.249970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1f56c-c0fe-4dd1-8c37-b9192051ed5e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:11.254784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:11.255721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:11.256005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:11.256459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] PATH_INFO: `/v3/projects/3b9a8ec163fd414293e023d806fa8b03` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:11.257669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9a8ec163fd414293e023d806fa8b03)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:11.260057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:11.306815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9a8ec163fd414293e023d806fa8b03', 'request_id': 'req-1a911df7-c4e4-4059-bd91-02cff261d4ab'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.313936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9a8ec163fd414293e023d806fa8b03', 'request_id': 'req-1a911df7-c4e4-4059-bd91-02cff261d4ab'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.319922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9a8ec163fd414293e023d806fa8b03', 'request_id': 'req-1a911df7-c4e4-4059-bd91-02cff261d4ab'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.331343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] The token cache is being invalidate because project 3b9a8ec163fd414293e023d806fa8b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:11.331630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.332284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.333852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1043/2074] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:11 2022] DELETE /identity/v3/projects/3b9a8ec163fd414293e023d806fa8b03 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:11.338778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:11.348161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b90218-6d45-497e-9ca6-cc66153e3927 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:11.425784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:11.426739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:11.427698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:11.428036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] PATH_INFO: `/v3/users/a11c53b5525444d3961453dcb4058de1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:11.429410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11c53b5525444d3961453dcb4058de1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:11.432032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:11.484383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11c53b5525444d3961453dcb4058de1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.494611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11c53b5525444d3961453dcb4058de1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.495389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11c53b5525444d3961453dcb4058de1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.496042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11c53b5525444d3961453dcb4058de1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.504330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11c53b5525444d3961453dcb4058de1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:11.525300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1032/2075] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:11 2022] DELETE /identity/v3/users/a11c53b5525444d3961453dcb4058de1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:11.826741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:11.828398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:11.847151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a911df7-c4e4-4059-bd91-02cff261d4ab admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:11.910701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:11.911558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:11.911832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:11.912099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] PATH_INFO: `/v3/projects/bec1939a65384d9e8cbf5e92a4a6b98b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:11.913267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec1939a65384d9e8cbf5e92a4a6b98b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:11.915398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:11.988711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec1939a65384d9e8cbf5e92a4a6b98b', 'request_id': 'req-690128ef-f27e-4a67-b4c5-58305fe2b254'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.006185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec1939a65384d9e8cbf5e92a4a6b98b', 'request_id': 'req-690128ef-f27e-4a67-b4c5-58305fe2b254'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.014343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec1939a65384d9e8cbf5e92a4a6b98b', 'request_id': 'req-690128ef-f27e-4a67-b4c5-58305fe2b254'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.029253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] The token cache is being invalidate because project bec1939a65384d9e8cbf5e92a4a6b98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:12.029647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.030322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.032165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1044/2076] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:11 2022] DELETE /identity/v3/projects/bec1939a65384d9e8cbf5e92a4a6b98b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:12.036481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:12.038042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:12.061514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80013624-1fd6-4199-997a-21ec602b3c6c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:12.127018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:12.128127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:12.128454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:12.128918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] PATH_INFO: `/v3/users/5b536df9154646f98c130b75a75bcd21` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:12.130261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b536df9154646f98c130b75a75bcd21)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:12.132346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:12.179602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b536df9154646f98c130b75a75bcd21'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.187075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b536df9154646f98c130b75a75bcd21'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.187676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b536df9154646f98c130b75a75bcd21'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.188414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b536df9154646f98c130b75a75bcd21'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.195622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c3375087-a872-453c-b512-8969eeddf20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b536df9154646f98c130b75a75bcd21'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.213430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1033/2077] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:12 2022] DELETE /identity/v3/users/5b536df9154646f98c130b75a75bcd21 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:12.700740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:12.702777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:12.732320 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690128ef-f27e-4a67-b4c5-58305fe2b254 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:12.818480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:12.819422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:12.819776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:12.820114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] PATH_INFO: `/v3/projects/88c0fa6b52cd4fae92b609546b25af69` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:12.821400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c0fa6b52cd4fae92b609546b25af69)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:12.823453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:12.873528 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c0fa6b52cd4fae92b609546b25af69', 'request_id': 'req-84111727-71bc-4edc-a07d-4e3278adc57a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.882179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c0fa6b52cd4fae92b609546b25af69', 'request_id': 'req-84111727-71bc-4edc-a07d-4e3278adc57a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.887824 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c0fa6b52cd4fae92b609546b25af69', 'request_id': 'req-84111727-71bc-4edc-a07d-4e3278adc57a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.898890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] The token cache is being invalidate because project 88c0fa6b52cd4fae92b609546b25af69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:12.899173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.900348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-84111727-71bc-4edc-a07d-4e3278adc57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:12.902174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1045/2078] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:12 2022] DELETE /identity/v3/projects/88c0fa6b52cd4fae92b609546b25af69 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:12.906741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22cbd2-fb3b-4597-85a8-92acbefc62af None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:12.907235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22cbd2-fb3b-4597-85a8-92acbefc62af None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:12.907328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22cbd2-fb3b-4597-85a8-92acbefc62af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:12.925585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7c22cbd2-fb3b-4597-85a8-92acbefc62af None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:12.926862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7c22cbd2-fb3b-4597-85a8-92acbefc62af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:12.986813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1034/2079] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:12.995116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2e23-fd1b-4dd6-887c-f60b75fda123 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:12.995116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2e23-fd1b-4dd6-887c-f60b75fda123 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:12.995277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2e23-fd1b-4dd6-887c-f60b75fda123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.015458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1aed2e23-fd1b-4dd6-887c-f60b75fda123 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:13.017040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1aed2e23-fd1b-4dd6-887c-f60b75fda123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:13.028550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1046/2080] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:13.032710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22cbd2-fb3b-4597-85a8-92acbefc62af None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.043135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22cbd2-fb3b-4597-85a8-92acbefc62af None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.048043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.048719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.048999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.049271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.050047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:13.050353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.051963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.064226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1035/2081] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:13.068736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2e23-fd1b-4dd6-887c-f60b75fda123 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.078058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2e23-fd1b-4dd6-887c-f60b75fda123 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.082853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.083573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.084005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.084116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.084754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.087203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.122606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1047/2082] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:13.124675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.138144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028de88-2510-43f8-a312-10aaecd83686 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.195151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.195820 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.196127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.196404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.197082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.199035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.219550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1036/2083] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:13 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:13.224225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.234736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a66d1f-4f9d-4571-93ba-c059350bf786 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.239444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.240103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.240383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.240657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.241373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.243020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.256085 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1048/2084] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:07:13.257290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.267683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3f1f3-0c66-4ad3-a54c-9b87a1aa9af5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.272351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d33e8-2cbd-4c86-b292-956253f71193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.273008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d33e8-2cbd-4c86-b292-956253f71193 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.273288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d33e8-2cbd-4c86-b292-956253f71193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.273600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d33e8-2cbd-4c86-b292-956253f71193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.274934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d33e8-2cbd-4c86-b292-956253f71193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.276528 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d33e8-2cbd-4c86-b292-956253f71193 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.288481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1037/2085] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:13.292790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.302925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2b9d-d1db-4184-82f9-c47fcdc879ac admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.307694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.308605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.308885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.309155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] PATH_INFO: `/v3/projects/986bb2abfe594acbb3effdccd2d5ae13/users/a49c5642f347448da4858f59c45d98de/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.325308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=986bb2abfe594acbb3effdccd2d5ae13, user_id=a49c5642f347448da4858f59c45d98de, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.328031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.342095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1049/2086] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:13 2022] PUT /identity/v3/projects/986bb2abfe594acbb3effdccd2d5ae13/users/a49c5642f347448da4858f59c45d98de/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:13.352948 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834231e-93f2-47a3-88f2-499286061aa6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.353235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834231e-93f2-47a3-88f2-499286061aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.353536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834231e-93f2-47a3-88f2-499286061aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.378808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3834231e-93f2-47a3-88f2-499286061aa6 None None] MFA Rules not processed for user `a49c5642f347448da4858f59c45d98de`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:13.380008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3834231e-93f2-47a3-88f2-499286061aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:13.448467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1038/2087] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:13.450945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.509962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb4b8f-d10e-4c3d-92df-ad0c6452c0ad admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.514680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.515333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.515614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.515883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.516554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.518731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.544506 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1050/2088] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:13.548449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834231e-93f2-47a3-88f2-499286061aa6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.559352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834231e-93f2-47a3-88f2-499286061aa6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.628406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.629079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.629353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.629702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.630330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.632244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.655616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1039/2089] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:13 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:13.657079 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.667990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482ffa-e224-4572-820e-a6cf8c8e4dfd admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.672649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.673329 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.673663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.673939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.674663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.676270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.688189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1051/2090] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:13.692284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.703426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8694-875b-4486-8829-1a0a71c1ab94 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.708418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7f8e8-541b-4388-8a19-ea1cfdf71a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.709140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7f8e8-541b-4388-8a19-ea1cfdf71a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.709420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7f8e8-541b-4388-8a19-ea1cfdf71a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.709730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7f8e8-541b-4388-8a19-ea1cfdf71a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.710480 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7f8e8-541b-4388-8a19-ea1cfdf71a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.712117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7f8e8-541b-4388-8a19-ea1cfdf71a48 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.725780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1040/2091] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:13.727099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.737284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4a9e9-8866-47e2-9437-b63b940a33f1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.742011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.742893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.743661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.743936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] PATH_INFO: `/v3/projects/82d243a1c93048ee950ff89d49fa144b/users/c48b0a2079344db996a93b9387e8cd6f/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.758091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d243a1c93048ee950ff89d49fa144b, user_id=c48b0a2079344db996a93b9387e8cd6f, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.761359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:13.776895 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1052/2092] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:13 2022] PUT /identity/v3/projects/82d243a1c93048ee950ff89d49fa144b/users/c48b0a2079344db996a93b9387e8cd6f/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:13.787038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a199d6b-ed7b-4e09-9f01-9c5f1ed1e9db None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.787386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a199d6b-ed7b-4e09-9f01-9c5f1ed1e9db None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.787762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a199d6b-ed7b-4e09-9f01-9c5f1ed1e9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.816682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7a199d6b-ed7b-4e09-9f01-9c5f1ed1e9db None None] MFA Rules not processed for user `c48b0a2079344db996a93b9387e8cd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:13.818061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7a199d6b-ed7b-4e09-9f01-9c5f1ed1e9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:13.899680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1041/2093] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:13.903871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:13.987076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e8cb5-9b53-4853-9e49-98a1a586d8bc admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:13.992015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:13.992668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:13.993574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:13.993864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:13.994557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:13.996459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:14.025575 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1053/2094] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:14.027009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a199d6b-ed7b-4e09-9f01-9c5f1ed1e9db None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:14.037555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a199d6b-ed7b-4e09-9f01-9c5f1ed1e9db None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:14.091071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:14.091736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:14.092014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:14.092286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:14.093024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:14.095097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:14.119486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1042/2095] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:14 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:14.122515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:14.135137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd699f14-9f1b-4c5c-86d2-f5e8583c5ae4 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:14.140485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:14.141157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:14.141438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:14.141760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:14.142739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:14.144326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:14.156308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1054/2096] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:14.160325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:14.171147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b90869-1466-4a77-809b-a11a59564d7c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:14.177252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:14.178281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:14.178479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:14.178698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] PATH_INFO: `/v3/projects/912ef16dd8bb4630a8464dbace58405a/users/e292681bd973480287bedb3ffc4110fa/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:14.199157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=912ef16dd8bb4630a8464dbace58405a, user_id=e292681bd973480287bedb3ffc4110fa, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:14.201969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:14.215093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1043/2097] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:14 2022] PUT /identity/v3/projects/912ef16dd8bb4630a8464dbace58405a/users/e292681bd973480287bedb3ffc4110fa/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:14.219033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:14.229200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aedbe-e534-48a5-8019-f202c398a21c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:14.290815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bd1ef-bc2b-435d-99e9-c4b18542a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:14.291529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bd1ef-bc2b-435d-99e9-c4b18542a86f admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:14.291800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bd1ef-bc2b-435d-99e9-c4b18542a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:14.292071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bd1ef-bc2b-435d-99e9-c4b18542a86f admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:14.292842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bd1ef-bc2b-435d-99e9-c4b18542a86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:14.295561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bd1ef-bc2b-435d-99e9-c4b18542a86f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:14.311844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1055/2098] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:14.313265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:14.323892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3b0f-65fe-40fa-96f0-a038dcd7efb6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:14.328501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:14.329384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:14.329693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:14.329961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] PATH_INFO: `/v3/projects/912ef16dd8bb4630a8464dbace58405a/users/e292681bd973480287bedb3ffc4110fa/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:14.331911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=912ef16dd8bb4630a8464dbace58405a, user_id=e292681bd973480287bedb3ffc4110fa, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:14.334597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:14.346109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1044/2099] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:14 2022] PUT /identity/v3/projects/912ef16dd8bb4630a8464dbace58405a/users/e292681bd973480287bedb3ffc4110fa/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:14.356676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:14.356961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:14.357233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:14.389642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] MFA Rules not processed for user `e292681bd973480287bedb3ffc4110fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:14.391118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:14.474454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1056/2100] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:14.487322 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:14.489158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:14.550590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3f45c-dc1b-4423-86aa-5e1e30b00d40 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:14.554220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:14.554861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:14.555140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:14.555595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:14.626302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:14.627700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:14.637615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1045/2101] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:16.144358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:16.145979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:16.158654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aebdd-e51e-4e30-8f40-17aab45a6308 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:16.163033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:16.163822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:16.164198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:16.164569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:16.239986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:16.242546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:16.253959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1057/2102] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:17.008673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:17.016915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474a35e-3fd4-42c6-b940-1a00acb3b5d4 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:17.020790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6652cda-05fc-4dc5-8943-fc2d5b7d5911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:17.021414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652cda-05fc-4dc5-8943-fc2d5b7d5911 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:17.021718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652cda-05fc-4dc5-8943-fc2d5b7d5911 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:17.021987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652cda-05fc-4dc5-8943-fc2d5b7d5911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:17.030596 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6652cda-05fc-4dc5-8943-fc2d5b7d5911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:17.031989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6652cda-05fc-4dc5-8943-fc2d5b7d5911 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:17.041448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1046/2103] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:17.109626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:17.111056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:17.173684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddedced-421b-449b-aecd-249434ed158b service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:17.178281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:17.179154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:17.179438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:17.179711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] PATH_INFO: `/v3/users/0a293358838f45e4b4ae59ee3b1ca28d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:17.181560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a293358838f45e4b4ae59ee3b1ca28d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:17.183468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:17.226100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a293358838f45e4b4ae59ee3b1ca28d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.233089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a293358838f45e4b4ae59ee3b1ca28d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.233746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a293358838f45e4b4ae59ee3b1ca28d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.241297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a293358838f45e4b4ae59ee3b1ca28d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.241969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a293358838f45e4b4ae59ee3b1ca28d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.259239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1058/2104] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:17 2022] DELETE /identity/v3/users/0a293358838f45e4b4ae59ee3b1ca28d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:17.263780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:17.264070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:17.264351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:17.280927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:17.282171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:17.338827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1047/2105] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:17.348236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:17.349664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:17.405629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890b9c2-0484-476e-bb4e-3a80081ebb44 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:17.409317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:17.409925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:17.410206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:17.410479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:17.419999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:17.421418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:17.430847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1059/2106] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:17.708432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:17.710142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:17.724129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c7112-382d-4efe-be02-b2000c3db0e2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:17.729555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:17.730408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:17.730688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:17.730960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] PATH_INFO: `/v3/projects/3e5ea9f658ed467a92cf45d7f775a6da` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:17.732148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5ea9f658ed467a92cf45d7f775a6da)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:17.734871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:17.780228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5ea9f658ed467a92cf45d7f775a6da', 'request_id': 'req-71d1378a-d4f3-4007-96dc-fa77319cf274'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.785585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5ea9f658ed467a92cf45d7f775a6da', 'request_id': 'req-71d1378a-d4f3-4007-96dc-fa77319cf274'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.792808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5ea9f658ed467a92cf45d7f775a6da', 'request_id': 'req-71d1378a-d4f3-4007-96dc-fa77319cf274'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.803813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] The token cache is being invalidate because project 3e5ea9f658ed467a92cf45d7f775a6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:17.804098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.804735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.806335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1048/2107] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:17 2022] DELETE /identity/v3/projects/3e5ea9f658ed467a92cf45d7f775a6da => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:17.810465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:17.819874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ecd7a-199f-475a-87c2-ae4683873815 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:17.881452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:17.883254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:17.884022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:17.884299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] PATH_INFO: `/v3/users/8e3dfe2bbb634bd59abc7afba225583a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:17.885572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3dfe2bbb634bd59abc7afba225583a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:17.887587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:17.934315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3dfe2bbb634bd59abc7afba225583a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.941031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3dfe2bbb634bd59abc7afba225583a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.941720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3dfe2bbb634bd59abc7afba225583a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.949758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3dfe2bbb634bd59abc7afba225583a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.950388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-562a003a-b520-467b-bddd-cc143e47e4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3dfe2bbb634bd59abc7afba225583a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:17.967597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1060/2108] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:17 2022] DELETE /identity/v3/users/8e3dfe2bbb634bd59abc7afba225583a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:18.223660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.225813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:18.239578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1378a-d4f3-4007-96dc-fa77319cf274 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.302279 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.303130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.303409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.303703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] PATH_INFO: `/v3/projects/d3a96c71f3d746e4a0cd5e12e13c4e77` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.304931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a96c71f3d746e4a0cd5e12e13c4e77)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.307286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:18.351113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a96c71f3d746e4a0cd5e12e13c4e77', 'request_id': 'req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:18.356176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a96c71f3d746e4a0cd5e12e13c4e77', 'request_id': 'req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:18.362894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a96c71f3d746e4a0cd5e12e13c4e77', 'request_id': 'req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:18.373737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] The token cache is being invalidate because project d3a96c71f3d746e4a0cd5e12e13c4e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:18.374017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:18.374657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6483ea85-daa8-4c7a-9c39-5ec099f0e80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:18.376164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1049/2109] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:18 2022] DELETE /identity/v3/projects/d3a96c71f3d746e4a0cd5e12e13c4e77 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:18.382608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0608aa-01dd-41e2-b0b1-62ad240a9e29 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.383203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0608aa-01dd-41e2-b0b1-62ad240a9e29 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.383203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0608aa-01dd-41e2-b0b1-62ad240a9e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.402542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2d0608aa-01dd-41e2-b0b1-62ad240a9e29 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:18.403741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2d0608aa-01dd-41e2-b0b1-62ad240a9e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:18.460286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1061/2110] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:18.468581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e566ba-4082-4e88-9ee8-f9d7918f4a1e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.468866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e566ba-4082-4e88-9ee8-f9d7918f4a1e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.469142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e566ba-4082-4e88-9ee8-f9d7918f4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.487069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f5e566ba-4082-4e88-9ee8-f9d7918f4a1e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:18.488244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f5e566ba-4082-4e88-9ee8-f9d7918f4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:18.496479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1050/2111] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:18.500436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0608aa-01dd-41e2-b0b1-62ad240a9e29 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.509828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0608aa-01dd-41e2-b0b1-62ad240a9e29 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.514206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.514847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.515125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.515421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.516125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:18.516427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.518277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:18.531222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1062/2112] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:18.535560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e566ba-4082-4e88-9ee8-f9d7918f4a1e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.544937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e566ba-4082-4e88-9ee8-f9d7918f4a1e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.549436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.550103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.550381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.550652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.551319 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.553198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:18.578250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1051/2113] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:18 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:18.582168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.593316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfd2c-6009-4883-9c68-62f2b6174840 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.658468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.659220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.659429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.659702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.660373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.662344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:18.682068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1063/2114] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:18 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:18.686380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.696754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e453b4-de67-4ea5-8b85-e2142bb4b9d2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.701656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.702386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.702750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.703090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.703883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.705573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:18.717500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1052/2115] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:18.721732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.733086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4207-cbcb-4bff-bc44-c2435bd87ac4 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.737798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95551-5af7-44b9-8a2a-55fed5a83a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.738456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95551-5af7-44b9-8a2a-55fed5a83a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.738738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95551-5af7-44b9-8a2a-55fed5a83a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.739008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95551-5af7-44b9-8a2a-55fed5a83a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.739745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95551-5af7-44b9-8a2a-55fed5a83a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.741382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95551-5af7-44b9-8a2a-55fed5a83a87 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:18.751931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1064/2116] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:18.756103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.765992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8dd97-c45c-48ae-863c-38f6a886e09e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.770800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.771669 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.771944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.772213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] PATH_INFO: `/v3/projects/d1091a5a84854b6780f59aed6a438d8f/users/04e254781a0d4a6c8a78e2b4f2ffa6b0/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.787585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1091a5a84854b6780f59aed6a438d8f, user_id=04e254781a0d4a6c8a78e2b4f2ffa6b0, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.790910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:18.804056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1053/2117] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:18 2022] PUT /identity/v3/projects/d1091a5a84854b6780f59aed6a438d8f/users/04e254781a0d4a6c8a78e2b4f2ffa6b0/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:18.815877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ed1ce-2a16-4331-96d1-d394ad05bb08 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.816162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ed1ce-2a16-4331-96d1-d394ad05bb08 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.816432 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ed1ce-2a16-4331-96d1-d394ad05bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.842250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-021ed1ce-2a16-4331-96d1-d394ad05bb08 None None] MFA Rules not processed for user `04e254781a0d4a6c8a78e2b4f2ffa6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:18.843366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-021ed1ce-2a16-4331-96d1-d394ad05bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:18.906263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1065/2118] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:18.918219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:18.919896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:18.977265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2b84-6362-4511-a382-6f5db815691f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:18.981386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ac8b-da5a-41e9-be4f-c129b7fe984b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:18.982062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ac8b-da5a-41e9-be4f-c129b7fe984b service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:18.982339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ac8b-da5a-41e9-be4f-c129b7fe984b service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:18.982612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ac8b-da5a-41e9-be4f-c129b7fe984b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:18.991008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ac8b-da5a-41e9-be4f-c129b7fe984b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:18.992416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ac8b-da5a-41e9-be4f-c129b7fe984b service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:19.001331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1054/2119] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:19.025122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ed1ce-2a16-4331-96d1-d394ad05bb08 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:19.084037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ed1ce-2a16-4331-96d1-d394ad05bb08 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:19.089217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:19.090141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.090435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.090702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] PATH_INFO: `/v3/users/04e254781a0d4a6c8a78e2b4f2ffa6b0` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.091899 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e254781a0d4a6c8a78e2b4f2ffa6b0)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:19.093896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:19.136136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e254781a0d4a6c8a78e2b4f2ffa6b0'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.142928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e254781a0d4a6c8a78e2b4f2ffa6b0'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.143590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e254781a0d4a6c8a78e2b4f2ffa6b0'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.151566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e254781a0d4a6c8a78e2b4f2ffa6b0'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.152364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e254781a0d4a6c8a78e2b4f2ffa6b0'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.170759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1066/2120] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:19 2022] DELETE /identity/v3/users/04e254781a0d4a6c8a78e2b4f2ffa6b0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:19.175292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.175581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.175853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.192512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:19.193923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:19.251779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1055/2121] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:19.262094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:19.263524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:19.317683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b877d-b89d-42c1-86fb-61361f163527 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:19.321819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaebb50-b45f-4fac-8689-b30e9695e0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:19.322446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebb50-b45f-4fac-8689-b30e9695e0bc service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.322721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebb50-b45f-4fac-8689-b30e9695e0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.322988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebb50-b45f-4fac-8689-b30e9695e0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.331702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaebb50-b45f-4fac-8689-b30e9695e0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:19.333186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaebb50-b45f-4fac-8689-b30e9695e0bc service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:19.344364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1067/2122] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:19.610470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:19.611997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:19.625997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a28e1-1bd6-475b-913b-855325f9a02d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:19.630564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:19.632109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.634531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.634531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] PATH_INFO: `/v3/projects/d1091a5a84854b6780f59aed6a438d8f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.634967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1091a5a84854b6780f59aed6a438d8f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:19.636906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:19.687493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1091a5a84854b6780f59aed6a438d8f', 'request_id': 'req-97b0453e-028d-40c9-be01-6448d4dee6f9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.692560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1091a5a84854b6780f59aed6a438d8f', 'request_id': 'req-97b0453e-028d-40c9-be01-6448d4dee6f9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.700772 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1091a5a84854b6780f59aed6a438d8f', 'request_id': 'req-97b0453e-028d-40c9-be01-6448d4dee6f9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.711254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] The token cache is being invalidate because project d1091a5a84854b6780f59aed6a438d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:19.711559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.712170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97b0453e-028d-40c9-be01-6448d4dee6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:19.713711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1056/2123] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:19 2022] DELETE /identity/v3/projects/d1091a5a84854b6780f59aed6a438d8f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:19.719458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988633e-df32-47e4-a474-386c0ca08c96 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.719934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988633e-df32-47e4-a474-386c0ca08c96 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.720039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988633e-df32-47e4-a474-386c0ca08c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.738864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0988633e-df32-47e4-a474-386c0ca08c96 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:19.740138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0988633e-df32-47e4-a474-386c0ca08c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:19.804463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1068/2124] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:19.813513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674728dc-7631-4315-8a05-e03f5420d7e2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.813804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674728dc-7631-4315-8a05-e03f5420d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.814081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674728dc-7631-4315-8a05-e03f5420d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.838476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-674728dc-7631-4315-8a05-e03f5420d7e2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:19.839806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-674728dc-7631-4315-8a05-e03f5420d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:19.852624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1057/2125] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:19.856829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988633e-df32-47e4-a474-386c0ca08c96 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:19.866377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988633e-df32-47e4-a474-386c0ca08c96 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:19.873179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:19.873930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.874212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.874488 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.875211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:19.875519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:19.877119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:19.889353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1069/2126] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:19.894109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674728dc-7631-4315-8a05-e03f5420d7e2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:19.903703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674728dc-7631-4315-8a05-e03f5420d7e2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:19.909205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:19.910011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:19.910396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:19.910777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:19.911609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:19.913740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:19.940930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1058/2127] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:19.948735 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:19.958610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27250e19-c874-4438-b0c3-02a04e22a904 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:20.022019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:20.022834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.023115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.023389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.024098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:20.026324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:20.047551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1070/2128] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:19 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:20.051477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:20.062966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bb1e2-4c27-4f00-831b-d85ed61ec4fe admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:20.067888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:20.068692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.068951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.069288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.070146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:20.072162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:20.083135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1059/2129] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:20.087412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:20.101419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8007-cd66-4fe1-9bf3-3722ba1129f0 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:20.107429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c8156-cf82-400a-9c40-af346a91c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:20.107914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8156-cf82-400a-9c40-af346a91c45e admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.108291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8156-cf82-400a-9c40-af346a91c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.108635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8156-cf82-400a-9c40-af346a91c45e admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.109424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c8156-cf82-400a-9c40-af346a91c45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:20.111033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c8156-cf82-400a-9c40-af346a91c45e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:20.125550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1071/2130] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:07:20.126729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:20.136635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0c80f-53fe-479a-b6c9-09a786b971be admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:20.141187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:20.142102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.142635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.142907 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] PATH_INFO: `/v3/projects/27f93186bd364a14bd287997a6856d47/users/2fe0ad6f92ee4330a55b4e1777a3319d/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.156947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f93186bd364a14bd287997a6856d47, user_id=2fe0ad6f92ee4330a55b4e1777a3319d, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:20.159676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:20.173180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1060/2131] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:20 2022] PUT /identity/v3/projects/27f93186bd364a14bd287997a6856d47/users/2fe0ad6f92ee4330a55b4e1777a3319d/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:20.184104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6611089-6f00-4710-bd63-8c896712aaf3 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.184391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6611089-6f00-4710-bd63-8c896712aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.184694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6611089-6f00-4710-bd63-8c896712aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.212033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e6611089-6f00-4710-bd63-8c896712aaf3 None None] MFA Rules not processed for user `2fe0ad6f92ee4330a55b4e1777a3319d`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:20.213239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e6611089-6f00-4710-bd63-8c896712aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:20.304435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1072/2132] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:20.317022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:20.319037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:20.385840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ff3ee-ff44-4a84-85e8-ad2d58729db5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:20.390329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e26ed-6367-42ca-8825-2d865e42cac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:20.391358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e26ed-6367-42ca-8825-2d865e42cac4 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.391710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e26ed-6367-42ca-8825-2d865e42cac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.392174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e26ed-6367-42ca-8825-2d865e42cac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.403069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e26ed-6367-42ca-8825-2d865e42cac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:20.404659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e26ed-6367-42ca-8825-2d865e42cac4 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:20.416468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1061/2133] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:20.444109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6611089-6f00-4710-bd63-8c896712aaf3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:20.509188 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6611089-6f00-4710-bd63-8c896712aaf3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:20.513766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:20.514638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.514915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.515265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] PATH_INFO: `/v3/users/2fe0ad6f92ee4330a55b4e1777a3319d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.516482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe0ad6f92ee4330a55b4e1777a3319d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:20.518675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:20.567235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe0ad6f92ee4330a55b4e1777a3319d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:20.573906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe0ad6f92ee4330a55b4e1777a3319d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:20.574591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe0ad6f92ee4330a55b4e1777a3319d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:20.581974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe0ad6f92ee4330a55b4e1777a3319d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:20.582577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe0ad6f92ee4330a55b4e1777a3319d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:20.599656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1073/2134] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:20 2022] DELETE /identity/v3/users/2fe0ad6f92ee4330a55b4e1777a3319d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:20.605032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.605321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.605627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.623962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:20.625180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:20.691551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1062/2135] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:20.701872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:20.703289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:20.772354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006eb4-d744-46ab-932c-28bf0fff7b52 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:20.777924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:20.778721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.779006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.779277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.788992 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:20.790489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:20.801030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1074/2136] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:21.144401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:21.145926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:21.174256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c632b6-630e-4330-b0e8-9503e3f41fec None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:21.190507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:21.191419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:21.191696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:21.191967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] PATH_INFO: `/v3/projects/27f93186bd364a14bd287997a6856d47` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:21.193152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f93186bd364a14bd287997a6856d47)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:21.195100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:21.244366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f93186bd364a14bd287997a6856d47', 'request_id': 'req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:21.251684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f93186bd364a14bd287997a6856d47', 'request_id': 'req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:21.260395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f93186bd364a14bd287997a6856d47', 'request_id': 'req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:21.274252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] The token cache is being invalidate because project 27f93186bd364a14bd287997a6856d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:21.274536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:21.275202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:21.277137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1063/2137] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:21 2022] DELETE /identity/v3/projects/27f93186bd364a14bd287997a6856d47 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:23.309669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:23.311153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:23.323585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb4c84-af03-42db-a299-ee017d349605 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:23.378707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:23.379611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:23.379896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:23.380170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] PATH_INFO: `/v3/users/719edb67e8ae41b885581ae3645dd85b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:23.381689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=719edb67e8ae41b885581ae3645dd85b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:23.384132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:23.439748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719edb67e8ae41b885581ae3645dd85b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.451118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719edb67e8ae41b885581ae3645dd85b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.452175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719edb67e8ae41b885581ae3645dd85b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.460957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719edb67e8ae41b885581ae3645dd85b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.462471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-760b3757-ada9-447e-91da-6c432116a0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719edb67e8ae41b885581ae3645dd85b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.488425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1075/2138] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:23 2022] DELETE /identity/v3/users/719edb67e8ae41b885581ae3645dd85b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:23.660618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:23.662120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:23.676611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d6bc-5a9a-4c0b-8058-024d5a65090f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:23.731988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:23.732858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:23.733126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:23.733414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] PATH_INFO: `/v3/projects/2b6009c7f43b406e850c819b5b50311c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:23.734589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6009c7f43b406e850c819b5b50311c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:23.736545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:23.780604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6009c7f43b406e850c819b5b50311c', 'request_id': 'req-1dfbbb3e-ae88-465b-99a8-07970a5088c9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.785843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6009c7f43b406e850c819b5b50311c', 'request_id': 'req-1dfbbb3e-ae88-465b-99a8-07970a5088c9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.792752 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6009c7f43b406e850c819b5b50311c', 'request_id': 'req-1dfbbb3e-ae88-465b-99a8-07970a5088c9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.803304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] The token cache is being invalidate because project 2b6009c7f43b406e850c819b5b50311c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:23.803615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.804253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1dfbbb3e-ae88-465b-99a8-07970a5088c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:23.805830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1064/2139] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:23 2022] DELETE /identity/v3/projects/2b6009c7f43b406e850c819b5b50311c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:23.811268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8314-cbcb-4557-addf-ca3dddde0e5a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:23.811563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8314-cbcb-4557-addf-ca3dddde0e5a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:23.811863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8314-cbcb-4557-addf-ca3dddde0e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:23.830600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-237d8314-cbcb-4557-addf-ca3dddde0e5a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:23.831817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-237d8314-cbcb-4557-addf-ca3dddde0e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:23.892158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1076/2140] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:23.901032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab327-9bd0-4cec-877d-34a79434dd87 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:23.901381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab327-9bd0-4cec-877d-34a79434dd87 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:23.901717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab327-9bd0-4cec-877d-34a79434dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:23.920688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-38bab327-9bd0-4cec-877d-34a79434dd87 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:23.921941 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-38bab327-9bd0-4cec-877d-34a79434dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:23.932853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1065/2141] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:23.937177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d8314-cbcb-4557-addf-ca3dddde0e5a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:23.947525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d8314-cbcb-4557-addf-ca3dddde0e5a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:23.952143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:23.952849 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:23.953129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:23.953397 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:23.954171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:23.954469 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:23.956047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:23.968620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1077/2142] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:23.973028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab327-9bd0-4cec-877d-34a79434dd87 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:23.982310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab327-9bd0-4cec-877d-34a79434dd87 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:23.986853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:23.987517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:23.987792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:23.988058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:23.988813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:23.990801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.016069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1066/2143] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:23 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:24.020578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.030734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ed26-9a0b-44d9-bf30-392e5c7ee1da admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.088887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.089602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.089885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.090157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.090833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.092765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.096698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.098638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:24.112439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb9f57-d84e-4654-80d9-af68ee9150d6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.116425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1078/2144] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:24 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:24.117375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.118056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.118988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.119268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.119541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] PATH_INFO: `/v3/users/a49c5642f347448da4858f59c45d98de` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.120736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49c5642f347448da4858f59c45d98de)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.122692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.127851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dd2b-ed93-4363-b054-84a9cae1e9f4 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.132416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.133086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.133972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.134246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.134949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.136518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.146470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1079/2145] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:24.150416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.159507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64f70-6150-4763-8344-b13c38141734 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.164190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.164856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.165137 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.165411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.166148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.167720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.169828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49c5642f347448da4858f59c45d98de'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.178833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49c5642f347448da4858f59c45d98de'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.183110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1080/2146] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:07:24.183238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49c5642f347448da4858f59c45d98de'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.183238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49c5642f347448da4858f59c45d98de'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.184022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.185860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:24.188158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f99697aa-9890-445b-9152-74515e5903cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49c5642f347448da4858f59c45d98de'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.198749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6610-9962-4360-9632-849a81db9eff admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.203581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b2e99-51f3-40e7-baca-e7584b47e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.204513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2e99-51f3-40e7-baca-e7584b47e09d admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.204796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2e99-51f3-40e7-baca-e7584b47e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.205069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2e99-51f3-40e7-baca-e7584b47e09d admin admin] PATH_INFO: `/v3/projects/ef1ba9318cf84308a3ff6ce6da85755d/users/98211cfafca84542a64f8b3f0b34303b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.205774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1067/2147] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:24 2022] DELETE /identity/v3/users/a49c5642f347448da4858f59c45d98de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:24.210210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.210492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.210766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.222378 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b2e99-51f3-40e7-baca-e7584b47e09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1ba9318cf84308a3ff6ce6da85755d, user_id=98211cfafca84542a64f8b3f0b34303b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.225144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b2e99-51f3-40e7-baca-e7584b47e09d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.230557 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:24.232135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:24.239424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1081/2148] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:24 2022] PUT /identity/v3/projects/ef1ba9318cf84308a3ff6ce6da85755d/users/98211cfafca84542a64f8b3f0b34303b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:07:24.244934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.245225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.245548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.263720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:24.264919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:24.300005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1068/2149] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:24.307931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.310043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:24.327201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1082/2150] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:24.336654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.338301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:24.377766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd82ba-7aac-4de4-9463-d8e5ba41c8aa None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.381617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.382431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.383080 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.383811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.394815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.396551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.402233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ec0f1-030a-448e-8968-df8d61336988 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.407419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.408077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.408352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.408619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.414262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1069/2151] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:24.418501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.419994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.431867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1083/2152] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:24.787659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.789837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:24.804740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b669240-981a-4250-9068-44fc45bb6964 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.816275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.817417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.817880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.818158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] PATH_INFO: `/v3/projects/986bb2abfe594acbb3effdccd2d5ae13` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.819374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986bb2abfe594acbb3effdccd2d5ae13)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.821881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:24.876923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986bb2abfe594acbb3effdccd2d5ae13', 'request_id': 'req-5c48bf32-aff0-45fd-9334-0aa611d77500'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.883766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986bb2abfe594acbb3effdccd2d5ae13', 'request_id': 'req-5c48bf32-aff0-45fd-9334-0aa611d77500'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.891631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986bb2abfe594acbb3effdccd2d5ae13', 'request_id': 'req-5c48bf32-aff0-45fd-9334-0aa611d77500'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.909628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] The token cache is being invalidate because project 986bb2abfe594acbb3effdccd2d5ae13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:24.909993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.910708 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:24.912543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1070/2153] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:24 2022] DELETE /identity/v3/projects/986bb2abfe594acbb3effdccd2d5ae13 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:24.917239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:24.926653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa1a0-7c0e-4701-aaf6-079418daddd0 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:24.987652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:24.988520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:24.988796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:24.989064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] PATH_INFO: `/v3/users/c48b0a2079344db996a93b9387e8cd6f` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:24.990270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48b0a2079344db996a93b9387e8cd6f)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:24.992171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:25.040350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48b0a2079344db996a93b9387e8cd6f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.047109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48b0a2079344db996a93b9387e8cd6f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.047790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48b0a2079344db996a93b9387e8cd6f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.056519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48b0a2079344db996a93b9387e8cd6f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.057293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48b0a2079344db996a93b9387e8cd6f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.077501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1084/2154] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:24 2022] DELETE /identity/v3/users/c48b0a2079344db996a93b9387e8cd6f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:25.401096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:25.403687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:25.420015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48bf32-aff0-45fd-9334-0aa611d77500 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:25.484843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:25.485751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:25.486263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:25.486536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] PATH_INFO: `/v3/projects/82d243a1c93048ee950ff89d49fa144b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:25.488013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d243a1c93048ee950ff89d49fa144b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:25.491039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:25.554381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d243a1c93048ee950ff89d49fa144b', 'request_id': 'req-07882bc5-a880-428f-a137-32c72cc7e86f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.562736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d243a1c93048ee950ff89d49fa144b', 'request_id': 'req-07882bc5-a880-428f-a137-32c72cc7e86f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.573873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d243a1c93048ee950ff89d49fa144b', 'request_id': 'req-07882bc5-a880-428f-a137-32c72cc7e86f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.587823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] The token cache is being invalidate because project 82d243a1c93048ee950ff89d49fa144b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:25.588116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.589609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.591729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1071/2155] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:25 2022] DELETE /identity/v3/projects/82d243a1c93048ee950ff89d49fa144b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:25.596821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:25.598728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:25.614569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba647b-2dcc-4988-a9cb-149ac6ecf5b8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:25.676241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:25.677210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:25.677588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:25.678053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] PATH_INFO: `/v3/users/e292681bd973480287bedb3ffc4110fa` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:25.679323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e292681bd973480287bedb3ffc4110fa)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:25.681873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:25.736336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e292681bd973480287bedb3ffc4110fa'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.744456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e292681bd973480287bedb3ffc4110fa'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.745385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e292681bd973480287bedb3ffc4110fa'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.757473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e292681bd973480287bedb3ffc4110fa'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.758247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99ffaa36-464e-4e7b-80f2-a31b0782ce86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e292681bd973480287bedb3ffc4110fa'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:25.782095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1085/2156] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:25 2022] DELETE /identity/v3/users/e292681bd973480287bedb3ffc4110fa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:26.447463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:26.449408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:26.466963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07882bc5-a880-428f-a137-32c72cc7e86f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:26.554343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:26.556119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:26.556553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:26.557002 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] PATH_INFO: `/v3/projects/912ef16dd8bb4630a8464dbace58405a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:26.559768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912ef16dd8bb4630a8464dbace58405a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:26.562672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:26.635873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912ef16dd8bb4630a8464dbace58405a', 'request_id': 'req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:26.642125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912ef16dd8bb4630a8464dbace58405a', 'request_id': 'req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:26.653727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912ef16dd8bb4630a8464dbace58405a', 'request_id': 'req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:26.666929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] The token cache is being invalidate because project 912ef16dd8bb4630a8464dbace58405a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:26.667397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:26.668070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:26.669999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1072/2157] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:26 2022] DELETE /identity/v3/projects/912ef16dd8bb4630a8464dbace58405a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:29.001096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec468e5f-a577-4cac-b44e-4414118ffd1b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:29.001561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec468e5f-a577-4cac-b44e-4414118ffd1b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:29.001876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec468e5f-a577-4cac-b44e-4414118ffd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:29.052637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ec468e5f-a577-4cac-b44e-4414118ffd1b None None] MFA Rules not processed for user `98211cfafca84542a64f8b3f0b34303b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:29.053901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ec468e5f-a577-4cac-b44e-4414118ffd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:29.128925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1086/2158] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:29.141362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:29.143250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:29.218754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8dd60-f8f4-4f02-9b3e-88f5974b8328 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:29.224647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd377-2bc0-4c2e-b90d-5617a0707ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:29.225307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd377-2bc0-4c2e-b90d-5617a0707ced service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:29.225627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd377-2bc0-4c2e-b90d-5617a0707ced service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:29.225904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd377-2bc0-4c2e-b90d-5617a0707ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:29.234472 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd377-2bc0-4c2e-b90d-5617a0707ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:29.236107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd377-2bc0-4c2e-b90d-5617a0707ced service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:29.246273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1073/2159] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:31.008734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c568-05ff-444d-8b36-49d2d2aef1b6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:31.009297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c568-05ff-444d-8b36-49d2d2aef1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:31.009297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c568-05ff-444d-8b36-49d2d2aef1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:31.032587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4894c568-05ff-444d-8b36-49d2d2aef1b6 None None] MFA Rules not processed for user `98211cfafca84542a64f8b3f0b34303b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:31.033833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4894c568-05ff-444d-8b36-49d2d2aef1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:31.042651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1087/2160] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:31.495700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d1e3-acaa-47d1-aedc-63c8875b1912 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:31.496189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d1e3-acaa-47d1-aedc-63c8875b1912 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:31.496296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d1e3-acaa-47d1-aedc-63c8875b1912 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:31.497674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1074/2161] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 19:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:07:31.503140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:31.503369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:31.503636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:31.526308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] MFA Rules not processed for user `39f773f90b8c47608040ee24866242f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:31.527821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:31.587841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1088/2162] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:07:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:31.609381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d1e3-acaa-47d1-aedc-63c8875b1912 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:31.611272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6652d1e3-acaa-47d1-aedc-63c8875b1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:31.626136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d1e3-acaa-47d1-aedc-63c8875b1912 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:31.629678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938ca2-7664-40ce-9f5d-cbcc32949565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:31.630332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938ca2-7664-40ce-9f5d-cbcc32949565 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:31.630608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938ca2-7664-40ce-9f5d-cbcc32949565 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:31.630876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938ca2-7664-40ce-9f5d-cbcc32949565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:31.638898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938ca2-7664-40ce-9f5d-cbcc32949565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:31.640342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938ca2-7664-40ce-9f5d-cbcc32949565 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:31.649214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1075/2163] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:32.736190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:32.737812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:32.816750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75376d4-b13e-44cb-bfb9-1911f0bbb724 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:32.821486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:32.822626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:32.823238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:32.823353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] PATH_INFO: `/v3/users/49cdd42c77604895b17a909f5913563c` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:32.824598 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cdd42c77604895b17a909f5913563c)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:32.826741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:32.877347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cdd42c77604895b17a909f5913563c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:32.884250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cdd42c77604895b17a909f5913563c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:32.884959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cdd42c77604895b17a909f5913563c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:32.894065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cdd42c77604895b17a909f5913563c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:32.894821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cdd42c77604895b17a909f5913563c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:32.911996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1089/2164] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:32 2022] DELETE /identity/v3/users/49cdd42c77604895b17a909f5913563c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:32.917020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:32.917521 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:32.917871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:32.936524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:32.937770 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:32.997363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1076/2165] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:33.006848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.008439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:33.065809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7856-730f-42e3-a80a-f08ab1f4ad17 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.069761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beea9d-37dc-4235-9d16-ad136abb4c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.070463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beea9d-37dc-4235-9d16-ad136abb4c11 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.070740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beea9d-37dc-4235-9d16-ad136abb4c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.071038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beea9d-37dc-4235-9d16-ad136abb4c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.080870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28beea9d-37dc-4235-9d16-ad136abb4c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.082341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28beea9d-37dc-4235-9d16-ad136abb4c11 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.092450 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1090/2166] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:33.435532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.437200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:33.451891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b53c64-8b56-4f0f-807e-8f7920a574f0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.457813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.459152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.459642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.460112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] PATH_INFO: `/v3/projects/af9b6b63b0214c8691eaaafd8854052b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.462966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9b6b63b0214c8691eaaafd8854052b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.467608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.528572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9b6b63b0214c8691eaaafd8854052b', 'request_id': 'req-75e09275-bba0-4a3b-a943-cd48c36863a7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:33.534356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9b6b63b0214c8691eaaafd8854052b', 'request_id': 'req-75e09275-bba0-4a3b-a943-cd48c36863a7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:33.543303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9b6b63b0214c8691eaaafd8854052b', 'request_id': 'req-75e09275-bba0-4a3b-a943-cd48c36863a7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:33.556638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] The token cache is being invalidate because project af9b6b63b0214c8691eaaafd8854052b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:33.556638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:33.557307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-75e09275-bba0-4a3b-a943-cd48c36863a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:33.562263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1077/2167] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:33 2022] DELETE /identity/v3/projects/af9b6b63b0214c8691eaaafd8854052b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:33.564006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25638820-2bd3-44d1-9a81-44831faf7f26 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.564293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25638820-2bd3-44d1-9a81-44831faf7f26 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.564564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25638820-2bd3-44d1-9a81-44831faf7f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.592138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-25638820-2bd3-44d1-9a81-44831faf7f26 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:33.593347 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-25638820-2bd3-44d1-9a81-44831faf7f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:33.656957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1091/2168] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:33.664127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a51e9-caf9-4ffa-bf7f-c823d9940f85 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.664412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a51e9-caf9-4ffa-bf7f-c823d9940f85 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.665132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a51e9-caf9-4ffa-bf7f-c823d9940f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.682696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-806a51e9-caf9-4ffa-bf7f-c823d9940f85 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:33.683914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-806a51e9-caf9-4ffa-bf7f-c823d9940f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:33.692097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1078/2169] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:33.697006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25638820-2bd3-44d1-9a81-44831faf7f26 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.706817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25638820-2bd3-44d1-9a81-44831faf7f26 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.712217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.713044 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.713400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.713820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.714548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:33.714855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.716441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.728144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1092/2170] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:07:33.732454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a51e9-caf9-4ffa-bf7f-c823d9940f85 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.741446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a51e9-caf9-4ffa-bf7f-c823d9940f85 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.746316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.746965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.747250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.747522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.748241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.750218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.775701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1079/2171] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:33 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:33.779924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.789911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7afb7-ad9c-4025-bcb2-c5fe4a8d587b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.843675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.844259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.844538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.844809 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.845491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.847391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.866957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1093/2172] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:33 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:33.871649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.881747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098cc6-6218-4067-9c0e-7a2b3569515b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.886942 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.887594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.887873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.888146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.888893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.890515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.900885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1080/2173] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:33.905112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.915845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21167c-1c59-4152-802f-009835f6f974 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.920338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0385c4-eac1-4648-aa19-123e36852db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.920984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0385c4-eac1-4648-aa19-123e36852db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.921262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0385c4-eac1-4648-aa19-123e36852db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.921569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0385c4-eac1-4648-aa19-123e36852db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.922276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0385c4-eac1-4648-aa19-123e36852db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.923845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0385c4-eac1-4648-aa19-123e36852db4 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.934452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1094/2174] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:33.939053 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:33.950052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0af4-43b3-447b-b484-8f1aee0fe5c0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:33.955302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:33.956219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:33.956494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:33.956762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] PATH_INFO: `/v3/projects/253bbd0defee4faf92eb8453dd4728fa/users/1298cdaba25f478a9ae358f87942ce8b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:33.978784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253bbd0defee4faf92eb8453dd4728fa, user_id=1298cdaba25f478a9ae358f87942ce8b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:33.981646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:33.995396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1081/2175] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:33 2022] PUT /identity/v3/projects/253bbd0defee4faf92eb8453dd4728fa/users/1298cdaba25f478a9ae358f87942ce8b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:34.001446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c04db-4052-421f-9495-41fde8dbbbed None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:34.001948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c04db-4052-421f-9495-41fde8dbbbed None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:34.002230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c04db-4052-421f-9495-41fde8dbbbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:34.020080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-615c04db-4052-421f-9495-41fde8dbbbed None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:34.021280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-615c04db-4052-421f-9495-41fde8dbbbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:34.079813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1095/2176] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:34.090483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:34.092297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:34.150629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6b42-ad12-4385-8958-f41832dafad9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:34.155237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:34.155881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:34.156158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:34.156429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:34.165556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:34.166978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:34.176224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1082/2177] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:35.080293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:35.080806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:35.081104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:35.111776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] MFA Rules not processed for user `1298cdaba25f478a9ae358f87942ce8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:35.113409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:35.205105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1096/2178] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:35.218121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:35.221493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:35.300857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835c25-8af1-49c8-9919-165c5061a00f service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:35.306944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eb8ac-4aa7-494f-8ca2-a6c91a3ba189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:35.308081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb8ac-4aa7-494f-8ca2-a6c91a3ba189 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:35.308517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb8ac-4aa7-494f-8ca2-a6c91a3ba189 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:35.309099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb8ac-4aa7-494f-8ca2-a6c91a3ba189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:35.323240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eb8ac-4aa7-494f-8ca2-a6c91a3ba189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:35.324971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eb8ac-4aa7-494f-8ca2-a6c91a3ba189 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:35.345613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1083/2179] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:36.029480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:36.031119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:36.045915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e72ae-f496-49ae-ac0f-849390bb49a0 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:36.050385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:36.051255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.051531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.051802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] PATH_INFO: `/v3/users/cec3a641a09648d79bd8569db97557a9` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.052973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec3a641a09648d79bd8569db97557a9)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:36.055948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:36.106356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec3a641a09648d79bd8569db97557a9'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.114611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec3a641a09648d79bd8569db97557a9'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.115321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec3a641a09648d79bd8569db97557a9'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.123481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec3a641a09648d79bd8569db97557a9'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.124161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec3a641a09648d79bd8569db97557a9'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.142787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1097/2180] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:07:36 2022] DELETE /identity/v3/users/cec3a641a09648d79bd8569db97557a9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:36.147731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.148049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.148837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.166489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:36.167670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:36.223819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1084/2181] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:36.234525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:36.235919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:36.295324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818c65-52ff-4448-b05f-b9d42620927c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:36.298910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e300-0b6e-41c4-8131-ad940d588b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:36.299547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e300-0b6e-41c4-8131-ad940d588b8a service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.299829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e300-0b6e-41c4-8131-ad940d588b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.300102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e300-0b6e-41c4-8131-ad940d588b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.308733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e300-0b6e-41c4-8131-ad940d588b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:36.310187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e300-0b6e-41c4-8131-ad940d588b8a service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:36.319341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1098/2182] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:36.581514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:36.583049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:36.595406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363966ff-fe76-417f-b2ce-64b40d6177cf None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:36.600006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:36.600864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.601171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.601517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] PATH_INFO: `/v3/projects/9a526aa99f1d4cbda826156de52c676d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.602698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a526aa99f1d4cbda826156de52c676d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:36.604631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:36.652078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a526aa99f1d4cbda826156de52c676d', 'request_id': 'req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.657405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a526aa99f1d4cbda826156de52c676d', 'request_id': 'req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.667421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a526aa99f1d4cbda826156de52c676d', 'request_id': 'req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.678195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] The token cache is being invalidate because project 9a526aa99f1d4cbda826156de52c676d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:07:36.678475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.679097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6ae451a6-0821-48c0-8a7f-d9e5bed499f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:07:36.680661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1085/2183] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:07:36 2022] DELETE /identity/v3/projects/9a526aa99f1d4cbda826156de52c676d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:36.685525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d5b4-f134-400b-bf54-06f5ab4ca116 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.685813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d5b4-f134-400b-bf54-06f5ab4ca116 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.686091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d5b4-f134-400b-bf54-06f5ab4ca116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.703806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e345d5b4-f134-400b-bf54-06f5ab4ca116 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:36.704983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e345d5b4-f134-400b-bf54-06f5ab4ca116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:36.767586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1099/2184] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:36.775824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bab5e6-6123-48c6-8b12-3ed3b3cb8505 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.776111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bab5e6-6123-48c6-8b12-3ed3b3cb8505 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.776387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bab5e6-6123-48c6-8b12-3ed3b3cb8505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.786857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18577df-25e7-4deb-bd0b-f3ff45582985 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.787145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18577df-25e7-4deb-bd0b-f3ff45582985 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.787424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18577df-25e7-4deb-bd0b-f3ff45582985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.795486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-68bab5e6-6123-48c6-8b12-3ed3b3cb8505 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:36.796690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-68bab5e6-6123-48c6-8b12-3ed3b3cb8505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:36.804219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e18577df-25e7-4deb-bd0b-f3ff45582985 None None] MFA Rules not processed for user `1298cdaba25f478a9ae358f87942ce8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:36.806401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1086/2185] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:36.806534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e18577df-25e7-4deb-bd0b-f3ff45582985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:36.810534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bab5e6-6123-48c6-8b12-3ed3b3cb8505 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:36.819225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bab5e6-6123-48c6-8b12-3ed3b3cb8505 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:36.824622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:36.825278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.825607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.825884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.826614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:07:36.826928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:36.828532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:36.842230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1087/2186] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:07:36.847098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:36.858167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4148-d7c3-4099-8f3d-e22cc6566a57 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:36.863059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:36.863710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.863993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.864262 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.865110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:36.867546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:36.876193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1100/2187] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:07:36.899733 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1088/2188] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:07:36 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:07:36.900887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18577df-25e7-4deb-bd0b-f3ff45582985 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:36.911275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18577df-25e7-4deb-bd0b-f3ff45582985 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:36.968999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:36.969750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:36.970030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:36.970305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:36.971010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:36.972964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:36.995651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1101/2189] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:07:36 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:07:36.997060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:37.007323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd44e-558c-433b-8a03-bfd022a49555 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:37.012712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:37.013368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:37.013677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:37.013949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:37.014671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:37.016284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:37.026503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1089/2190] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:37.030671 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:37.040663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8fd0b-c1a0-4d39-af5e-c7a35d6db1a5 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:37.045227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb59a73-dbdf-4aa3-80cc-c7b2ec2b1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:37.045918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59a73-dbdf-4aa3-80cc-c7b2ec2b1fab admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:37.046198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59a73-dbdf-4aa3-80cc-c7b2ec2b1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:37.046466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59a73-dbdf-4aa3-80cc-c7b2ec2b1fab admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:37.047180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb59a73-dbdf-4aa3-80cc-c7b2ec2b1fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:37.049407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb59a73-dbdf-4aa3-80cc-c7b2ec2b1fab admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:37.059683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1102/2191] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:07:37.063935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:37.074494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee98c9-1a93-4dc7-8f23-b9f736d9045f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:37.079419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:37.080395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:37.080747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:37.081091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] PATH_INFO: `/v3/projects/fedb3ef21b1e413395b1a4cdcfb3f4d6/users/632af5ddc209419a93461afdb070fc87/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:37.095783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedb3ef21b1e413395b1a4cdcfb3f4d6, user_id=632af5ddc209419a93461afdb070fc87, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:37.098486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:37.112461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1090/2192] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:07:37 2022] PUT /identity/v3/projects/fedb3ef21b1e413395b1a4cdcfb3f4d6/users/632af5ddc209419a93461afdb070fc87/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:07:37.118170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1825-acd7-46fe-a6a1-1df927081afc None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:37.118694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1825-acd7-46fe-a6a1-1df927081afc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:37.118789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1825-acd7-46fe-a6a1-1df927081afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:37.136653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-182a1825-acd7-46fe-a6a1-1df927081afc None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:37.137929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-182a1825-acd7-46fe-a6a1-1df927081afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:37.216673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1103/2193] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:37.230127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:37.231865 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:37.293242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fa38a-4dad-4cf9-8679-2c730c767e04 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:37.297023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:37.298177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:37.298177 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:37.298416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:37.307975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:37.309341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:37.318996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1091/2194] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:38.324476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081f7a-e28b-482e-b5ae-fc30cebec4d6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:38.325028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081f7a-e28b-482e-b5ae-fc30cebec4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:38.325855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081f7a-e28b-482e-b5ae-fc30cebec4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:38.370316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-21081f7a-e28b-482e-b5ae-fc30cebec4d6 None None] MFA Rules not processed for user `632af5ddc209419a93461afdb070fc87`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:38.371808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-21081f7a-e28b-482e-b5ae-fc30cebec4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:38.448020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1104/2195] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:38.459425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:38.461672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:38.519447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ac8e-abc0-4772-90cf-527efa2e26e6 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:38.523144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eebb9-a03b-437c-8524-b84a65853bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:38.523819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eebb9-a03b-437c-8524-b84a65853bfe service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:38.524094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eebb9-a03b-437c-8524-b84a65853bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:38.524518 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eebb9-a03b-437c-8524-b84a65853bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:38.533090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eebb9-a03b-437c-8524-b84a65853bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:38.534577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eebb9-a03b-437c-8524-b84a65853bfe service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:38.543156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1092/2196] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:07:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:07:39.900551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425acce-eca3-41d5-b6a0-a2bbb2a8e10d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:39.901096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425acce-eca3-41d5-b6a0-a2bbb2a8e10d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:39.901298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425acce-eca3-41d5-b6a0-a2bbb2a8e10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:39.919229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5425acce-eca3-41d5-b6a0-a2bbb2a8e10d None None] MFA Rules not processed for user `632af5ddc209419a93461afdb070fc87`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:39.920629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5425acce-eca3-41d5-b6a0-a2bbb2a8e10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:39.927869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1105/2197] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:57.381883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:57.382342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:57.382931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:57.404609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] MFA Rules not processed for user `1298cdaba25f478a9ae358f87942ce8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:57.406042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:57.469745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1093/2198] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:20.853912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98bf34-8c0e-423d-92e5-a96158264895 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:20.854402 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98bf34-8c0e-423d-92e5-a96158264895 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:20.854501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98bf34-8c0e-423d-92e5-a96158264895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:20.871379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7f98bf34-8c0e-423d-92e5-a96158264895 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:20.872538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7f98bf34-8c0e-423d-92e5-a96158264895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:20.927439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1106/2199] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:08:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:20.977617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:20.979409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:21.046705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce519c49-5c21-4133-8d10-744195e551d0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:21.051560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:21.052193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:21.052466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:21.052740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:21.060501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:21.062098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:21.069726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1094/2200] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:08:30.862050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1a32-9d45-4d2f-9fc1-62419c070e18 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:30.862663 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1a32-9d45-4d2f-9fc1-62419c070e18 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:30.863177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1a32-9d45-4d2f-9fc1-62419c070e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:30.901066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-fb9d1a32-9d45-4d2f-9fc1-62419c070e18 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:30.903339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-fb9d1a32-9d45-4d2f-9fc1-62419c070e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:30.947626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1107/2201] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:08:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:30.966758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:31.025606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38141da2-6559-4d99-8976-f8ecf21e3117 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:31.031325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:31.031997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:31.032281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:31.032563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:31.041516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:31.043133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:31.060019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1095/2202] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:08:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:08:40.425099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:40.425686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:40.425686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:40.470146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:40.471409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:40.497926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1108/2203] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 19:08:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:40.505572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:40.523356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d440-8425-4970-8ace-721b1d6accd6 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:40.528955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:40.529931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:40.530379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:40.530788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:40.549636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:40.551307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:40.563390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1096/2204] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:08:45.016169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:45.018127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:45.113844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4edf-aba5-467a-95c2-301605dfd49e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:45.122427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:45.123688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:45.124141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:45.124797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] PATH_INFO: `/v3/users/1298cdaba25f478a9ae358f87942ce8b` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:45.126388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1298cdaba25f478a9ae358f87942ce8b)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:45.128974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:45.211902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1298cdaba25f478a9ae358f87942ce8b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.220344 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1298cdaba25f478a9ae358f87942ce8b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.221078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1298cdaba25f478a9ae358f87942ce8b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.231864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1298cdaba25f478a9ae358f87942ce8b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.232633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-983fa340-e92c-48c3-b317-0ef414a49d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1298cdaba25f478a9ae358f87942ce8b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.257517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1109/2205] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:08:45 2022] DELETE /identity/v3/users/1298cdaba25f478a9ae358f87942ce8b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:08:45.543426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:45.564988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2513fdb-b0fa-4e14-b1a5-e13566032852 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:45.635256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:45.636081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:45.636359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:45.636631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] PATH_INFO: `/v3/projects/253bbd0defee4faf92eb8453dd4728fa` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:45.637871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253bbd0defee4faf92eb8453dd4728fa)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:45.639851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:45.687616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253bbd0defee4faf92eb8453dd4728fa', 'request_id': 'req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.693180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253bbd0defee4faf92eb8453dd4728fa', 'request_id': 'req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.701344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253bbd0defee4faf92eb8453dd4728fa', 'request_id': 'req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.712955 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] The token cache is being invalidate because project 253bbd0defee4faf92eb8453dd4728fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:08:45.713330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.714042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8a0bf1a5-e9c9-44fd-9b19-378a3bb8acc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:45.715824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1097/2206] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:08:45 2022] DELETE /identity/v3/projects/253bbd0defee4faf92eb8453dd4728fa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:08:45.720798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd281-a3a8-4e47-a77c-c07f56522db3 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:45.721360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd281-a3a8-4e47-a77c-c07f56522db3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:45.721360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd281-a3a8-4e47-a77c-c07f56522db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:45.777596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d41dd281-a3a8-4e47-a77c-c07f56522db3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:45.778806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d41dd281-a3a8-4e47-a77c-c07f56522db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:45.836733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1110/2207] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:08:45.844592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f445e8-d786-4984-8c59-511ab67f4335 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:45.844877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f445e8-d786-4984-8c59-511ab67f4335 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:45.845152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f445e8-d786-4984-8c59-511ab67f4335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:45.871796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b4f445e8-d786-4984-8c59-511ab67f4335 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:45.873710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b4f445e8-d786-4984-8c59-511ab67f4335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:45.883500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1098/2208] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:45.887691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd281-a3a8-4e47-a77c-c07f56522db3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:45.898672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd281-a3a8-4e47-a77c-c07f56522db3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:45.903720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:45.904407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:45.904685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:45.904954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:45.905705 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:08:45.906007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:45.907631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:45.920601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1111/2209] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:08:45.924954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f445e8-d786-4984-8c59-511ab67f4335 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:45.933998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f445e8-d786-4984-8c59-511ab67f4335 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:45.942802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:45.943721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:45.944237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:45.944694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:45.945628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:45.947745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:45.984128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1099/2210] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:08:45 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:08:45.985325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:45.995527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8295f8-6d71-4a07-b059-bfeb5f4e3daa admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:46.050219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:46.051608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:46.051885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:46.052155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:46.052842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:46.054807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:46.075319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1112/2211] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:08:45 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:08:46.079484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:46.092155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec0710-0fa8-4df0-b56a-ee157aef810e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:46.098108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:46.098774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:46.099054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:46.099592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:46.100474 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:46.102812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:46.116906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1100/2212] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:08:46.118118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:46.129357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30588f5b-d3d2-4098-9f69-0fe5d171667e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:46.134942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cace53-f6e1-4bf5-9ace-cf3ffe2d8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:46.135622 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cace53-f6e1-4bf5-9ace-cf3ffe2d8f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:46.136100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cace53-f6e1-4bf5-9ace-cf3ffe2d8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:46.136385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cace53-f6e1-4bf5-9ace-cf3ffe2d8f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:46.137270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cace53-f6e1-4bf5-9ace-cf3ffe2d8f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:46.139230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cace53-f6e1-4bf5-9ace-cf3ffe2d8f7e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:46.154093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1113/2213] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:08:46.155610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:46.173424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2282c-f35b-4e0a-ba11-65eb28487500 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:46.179399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:46.180459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:46.180740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:46.181012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] PATH_INFO: `/v3/projects/9b7d162802ee42949d5927731ef3818f/users/e27e22b0e26f4ba1ae30dea7f6d7682b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:46.199558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7d162802ee42949d5927731ef3818f, user_id=e27e22b0e26f4ba1ae30dea7f6d7682b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:46.202563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:46.226486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1101/2214] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:08:46 2022] PUT /identity/v3/projects/9b7d162802ee42949d5927731ef3818f/users/e27e22b0e26f4ba1ae30dea7f6d7682b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:08:46.236619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a0b9a-8256-4cfa-9f93-275eb8bcf5c2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:46.236983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a0b9a-8256-4cfa-9f93-275eb8bcf5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:46.237354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a0b9a-8256-4cfa-9f93-275eb8bcf5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:46.265209 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5a0a0b9a-8256-4cfa-9f93-275eb8bcf5c2 None None] MFA Rules not processed for user `e27e22b0e26f4ba1ae30dea7f6d7682b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:46.266499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5a0a0b9a-8256-4cfa-9f93-275eb8bcf5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:46.340149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1114/2215] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:08:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:46.351282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:46.353147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:46.431837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c313ba8-be7f-42a6-adaa-9f657c5f15df admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:46.436424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:46.437067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:46.437582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:46.437879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:46.447922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:46.449352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:46.460932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1102/2216] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:08:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:08:46.703325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8499c8-cb66-4c67-b2e1-fa6e67a997cb None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:46.703325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8499c8-cb66-4c67-b2e1-fa6e67a997cb None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:46.703325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8499c8-cb66-4c67-b2e1-fa6e67a997cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:46.722827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7e8499c8-cb66-4c67-b2e1-fa6e67a997cb None None] MFA Rules not processed for user `47deb39e5d954424a4fb4e97375443f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:46.724076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7e8499c8-cb66-4c67-b2e1-fa6e67a997cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:46.779423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1115/2217] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:08:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:49.023466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:49.086163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6f78e-5112-4b58-9cb4-46494e8ae264 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:49.091296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:49.092296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:49.092779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:49.093100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] PATH_INFO: `/v3/users/e27e22b0e26f4ba1ae30dea7f6d7682b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:49.094439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27e22b0e26f4ba1ae30dea7f6d7682b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:49.096363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:49.158514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27e22b0e26f4ba1ae30dea7f6d7682b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:49.171304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27e22b0e26f4ba1ae30dea7f6d7682b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:49.173141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27e22b0e26f4ba1ae30dea7f6d7682b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:49.175307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27e22b0e26f4ba1ae30dea7f6d7682b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:49.188809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27e22b0e26f4ba1ae30dea7f6d7682b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:49.214077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1103/2218] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:08:49 2022] DELETE /identity/v3/users/e27e22b0e26f4ba1ae30dea7f6d7682b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:08:49.215668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7002-82b7-473c-8ddc-9000fc81a7d2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:49.216128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7002-82b7-473c-8ddc-9000fc81a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:49.216230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7002-82b7-473c-8ddc-9000fc81a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:49.247860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c5af7002-82b7-473c-8ddc-9000fc81a7d2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:49.249236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c5af7002-82b7-473c-8ddc-9000fc81a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:49.343701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1116/2219] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:49.355783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:49.357167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:49.445895 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de040848-0ac0-415c-9146-148b1807b0b4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:49.452439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90323bb-a5b3-4071-bc0c-53ccd716ef04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:49.453162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90323bb-a5b3-4071-bc0c-53ccd716ef04 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:49.453611 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90323bb-a5b3-4071-bc0c-53ccd716ef04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:49.453964 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90323bb-a5b3-4071-bc0c-53ccd716ef04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:49.466123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90323bb-a5b3-4071-bc0c-53ccd716ef04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:49.466123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90323bb-a5b3-4071-bc0c-53ccd716ef04 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:49.475206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1104/2220] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:08:49.668849 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08593-9651-449f-b4b9-17eb71389f17 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:49.669147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08593-9651-449f-b4b9-17eb71389f17 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:49.669422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08593-9651-449f-b4b9-17eb71389f17 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:49.670880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1117/2221] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 19:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:08:49.677947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:49.678624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:49.679242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:49.731081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:49.732414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:49.816584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1105/2222] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 19:08:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:49.828684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f08593-9651-449f-b4b9-17eb71389f17 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:49.830389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b6f08593-9651-449f-b4b9-17eb71389f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:49.886679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f08593-9651-449f-b4b9-17eb71389f17 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:49.890779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1928518-f0f2-4a01-9e30-908d7647f608 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9c380955a04c24af2823e22fe3ec70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:49.892199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1928518-f0f2-4a01-9e30-908d7647f608 service glance] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:49.892199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1928518-f0f2-4a01-9e30-908d7647f608 service glance] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:49.892593 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1928518-f0f2-4a01-9e30-908d7647f608 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:49.918814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1928518-f0f2-4a01-9e30-908d7647f608 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:49.920250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1928518-f0f2-4a01-9e30-908d7647f608 service glance] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:49.934820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1118/2223] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:08:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:08:50.038641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:50.040288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:50.047504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3bd9-475d-47ec-af92-91c086ebc0b6 None None] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:50.048258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3bd9-475d-47ec-af92-91c086ebc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:50.048806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3bd9-475d-47ec-af92-91c086ebc0b6 None None] PATH_INFO: `/` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:50.051033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1119/2224] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 19:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 19:08:50.054081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1624e1-d38c-474c-a855-cf80ef54515b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:50.056101 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fefb2-7693-41cd-a777-a58fc50972e9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:50.057399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fefb2-7693-41cd-a777-a58fc50972e9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:50.057970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fefb2-7693-41cd-a777-a58fc50972e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:50.060138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:50.061359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:50.061865 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:50.062351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] PATH_INFO: `/v3/projects/9b7d162802ee42949d5927731ef3818f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:50.063746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7d162802ee42949d5927731ef3818f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:50.065987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:50.121765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e79fefb2-7693-41cd-a777-a58fc50972e9 None None] MFA Rules not processed for user `39f773f90b8c47608040ee24866242f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:50.124979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e79fefb2-7693-41cd-a777-a58fc50972e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:50.139739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1120/2225] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 19:08:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:08:50.153265 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fefb2-7693-41cd-a777-a58fc50972e9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:50.154496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7d162802ee42949d5927731ef3818f', 'request_id': 'req-cf299d5b-a0c0-4309-a016-602195e38bb7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:50.160505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7d162802ee42949d5927731ef3818f', 'request_id': 'req-cf299d5b-a0c0-4309-a016-602195e38bb7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:50.168638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fefb2-7693-41cd-a777-a58fc50972e9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:50.172809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7d162802ee42949d5927731ef3818f', 'request_id': 'req-cf299d5b-a0c0-4309-a016-602195e38bb7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:50.189807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] The token cache is being invalidate because project 9b7d162802ee42949d5927731ef3818f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:08:50.190419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:50.191613 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cf299d5b-a0c0-4309-a016-602195e38bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:50.193506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1106/2226] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:08:50 2022] DELETE /identity/v3/projects/9b7d162802ee42949d5927731ef3818f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:08:50.231959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a1c4e-eb29-4efe-8f88-44d2dae3a095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:50.232706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a1c4e-eb29-4efe-8f88-44d2dae3a095 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:50.232918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a1c4e-eb29-4efe-8f88-44d2dae3a095 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:50.233170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a1c4e-eb29-4efe-8f88-44d2dae3a095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:50.235176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c37a1c4e-eb29-4efe-8f88-44d2dae3a095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:50.246772 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a1c4e-eb29-4efe-8f88-44d2dae3a095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:50.248393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a1c4e-eb29-4efe-8f88-44d2dae3a095 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:50.260623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1121/2227] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:08:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:08:50.362294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475988-86a5-402c-9d45-4b44359a8e92 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:50.362828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475988-86a5-402c-9d45-4b44359a8e92 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:50.363997 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475988-86a5-402c-9d45-4b44359a8e92 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:50.366910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1107/2228] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 19:08:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:08:50.374266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40d1d3-9744-49a3-a517-337c1927f2b6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:50.374558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40d1d3-9744-49a3-a517-337c1927f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:50.374838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40d1d3-9744-49a3-a517-337c1927f2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:50.401232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7a40d1d3-9744-49a3-a517-337c1927f2b6 None None] MFA Rules not processed for user `ea420049f83643a19cb6c1d0a36fc8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:50.402610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7a40d1d3-9744-49a3-a517-337c1927f2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:50.476526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1122/2229] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 19:08:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:50.489246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475988-86a5-402c-9d45-4b44359a8e92 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:50.491556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-eb475988-86a5-402c-9d45-4b44359a8e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:50.506202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475988-86a5-402c-9d45-4b44359a8e92 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:50.513561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:50.514300 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:50.514587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:50.514895 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:50.526823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:50.528326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:50.541168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1108/2230] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:08:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:08:58.096479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937436-165c-4383-858c-107c13e8e365 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:58.096923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937436-165c-4383-858c-107c13e8e365 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:58.097083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937436-165c-4383-858c-107c13e8e365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:58.114149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a0937436-165c-4383-858c-107c13e8e365 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:08:58.115314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a0937436-165c-4383-858c-107c13e8e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:58.167513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1123/2231] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:08:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:08:58.180530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:58.182093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:58.257392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be413e-933f-4155-84d9-83bdb4d11cd6 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:58.262476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d51ac4-ee67-4656-b98e-e2e102b9f7bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:58.263129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51ac4-ee67-4656-b98e-e2e102b9f7bb service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:58.263405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51ac4-ee67-4656-b98e-e2e102b9f7bb service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:58.263671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51ac4-ee67-4656-b98e-e2e102b9f7bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:58.272230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d51ac4-ee67-4656-b98e-e2e102b9f7bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:58.273852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d51ac4-ee67-4656-b98e-e2e102b9f7bb service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:58.282945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1109/2232] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:08:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:09:07.565408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:07.566020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:07.566116 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:07.583744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] MFA Rules not processed for user `632af5ddc209419a93461afdb070fc87`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:09:07.586060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:07.641739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1124/2233] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:09:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:09:15.743101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2922e-64d5-4a12-b293-e9f4245a2480 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:15.743659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2922e-64d5-4a12-b293-e9f4245a2480 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:15.743659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2922e-64d5-4a12-b293-e9f4245a2480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:15.761979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-09d2922e-64d5-4a12-b293-e9f4245a2480 None None] MFA Rules not processed for user `98211cfafca84542a64f8b3f0b34303b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:09:15.763377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-09d2922e-64d5-4a12-b293-e9f4245a2480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:15.820155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1110/2234] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:09:19.250171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:09:19.251587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:19.389274 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026b2db-e83f-427a-9f58-bd0b64381c61 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:09:19.395729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:09:19.396408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:19.396679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:19.397252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:19.399443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:19.412094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:09:19.414644 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:09:19.426196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1125/2235] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:09:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:09:24.957187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:24.957787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:24.957787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:25.011444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:09:25.012836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:25.029541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1111/2236] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 19:09:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:09:25.050860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:09:25.071520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1eab7-2bb6-43d1-ac5b-ea7a187206fb service placement] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:09:25.076465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:09:25.077095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:25.077377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:25.077684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:25.085407 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:09:25.086993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:09:25.094742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1126/2237] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:09:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:10:15.853018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:15.854443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:15.921586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2ff06-b90c-411d-b5f6-2ea609736075 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:15.926009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:15.926872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:15.927152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:15.927426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] PATH_INFO: `/v3/users/632af5ddc209419a93461afdb070fc87` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:15.928609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632af5ddc209419a93461afdb070fc87)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:15.930557 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:15.977066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632af5ddc209419a93461afdb070fc87'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:15.983962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632af5ddc209419a93461afdb070fc87'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:15.984830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632af5ddc209419a93461afdb070fc87'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:15.985437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632af5ddc209419a93461afdb070fc87'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:15.992087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-154606b8-1c14-43de-b22f-bdf9ce938892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632af5ddc209419a93461afdb070fc87'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:16.011032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1112/2238] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:10:15 2022] DELETE /identity/v3/users/632af5ddc209419a93461afdb070fc87 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:10:16.176135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.186277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaf3aa-3298-4b9e-96fc-3544dc8c4e6e service swift] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.246270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.247122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.247404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.247677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] PATH_INFO: `/v3/projects/fedb3ef21b1e413395b1a4cdcfb3f4d6` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.248834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedb3ef21b1e413395b1a4cdcfb3f4d6)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.250770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.294926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'request_id': 'req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:16.301379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'request_id': 'req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:16.306660 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'request_id': 'req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:16.317201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] The token cache is being invalidate because project fedb3ef21b1e413395b1a4cdcfb3f4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:10:16.317515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:16.318133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d9bf178f-e4f3-40fd-b4da-60515a3d8fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:16.320141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1127/2239] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:10:16 2022] DELETE /identity/v3/projects/fedb3ef21b1e413395b1a4cdcfb3f4d6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:10:16.324969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871143ca-3944-4026-9eb3-02e6611aa0ed None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.325260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871143ca-3944-4026-9eb3-02e6611aa0ed None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.325577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871143ca-3944-4026-9eb3-02e6611aa0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.343200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-871143ca-3944-4026-9eb3-02e6611aa0ed None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:16.344395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-871143ca-3944-4026-9eb3-02e6611aa0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:16.402593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1113/2240] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:16.410262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6dd2a-bc6a-4d88-913d-1f576e391077 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.410572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6dd2a-bc6a-4d88-913d-1f576e391077 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.410847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6dd2a-bc6a-4d88-913d-1f576e391077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.429500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5db6dd2a-bc6a-4d88-913d-1f576e391077 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:16.430621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5db6dd2a-bc6a-4d88-913d-1f576e391077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:16.438361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1128/2241] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:16.442310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871143ca-3944-4026-9eb3-02e6611aa0ed None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.452117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871143ca-3944-4026-9eb3-02e6611aa0ed None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.456580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.457214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.457507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.457779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.458490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:10:16.458791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.461011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.472446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1114/2242] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:10:16.476552 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6dd2a-bc6a-4d88-913d-1f576e391077 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.485574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6dd2a-bc6a-4d88-913d-1f576e391077 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.490138 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.491262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.491564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.491833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.492510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.494434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.519473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1129/2243] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:10:16 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:10:16.523344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.533133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca42ea-3be3-4238-bf4f-84352ad44b51 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.585771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.586426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.586710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.586981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.587660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.589583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.609391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1115/2244] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:10:16 2022] POST /identity/v3/users => generated 296 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:10:16.618939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.628962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ebd0b-6f07-4bc3-8490-5f15a9c9b638 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.634094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.634741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.635021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.635295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.636008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.637636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.648639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1130/2245] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:10:16.653590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.665352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b242e1-6e64-41a7-b7f0-60a062158ebe admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.670195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bc921-a65a-456e-812b-92888ba26083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.670849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bc921-a65a-456e-812b-92888ba26083 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.671129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bc921-a65a-456e-812b-92888ba26083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.671405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bc921-a65a-456e-812b-92888ba26083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.672131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bc921-a65a-456e-812b-92888ba26083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.673755 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bc921-a65a-456e-812b-92888ba26083 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.684740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1116/2246] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:10:16.688849 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.699226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1d2f8-a948-43cd-8c10-1e962915738f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.703808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.704673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.704952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.705218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] PATH_INFO: `/v3/projects/147cef469ddf40ce94d40fa65989ee10/users/fa831b66d72944dcbcd48e2542790f80/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.719143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] RBAC: Authorizing `identity:create_grant(project_id=147cef469ddf40ce94d40fa65989ee10, user_id=fa831b66d72944dcbcd48e2542790f80, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.721786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.734256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1131/2247] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:10:16 2022] PUT /identity/v3/projects/147cef469ddf40ce94d40fa65989ee10/users/fa831b66d72944dcbcd48e2542790f80/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:10:16.745263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66a1a-170b-4961-bbca-fc8ea171bcf9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.745590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66a1a-170b-4961-bbca-fc8ea171bcf9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.745869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66a1a-170b-4961-bbca-fc8ea171bcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.772460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5ee66a1a-170b-4961-bbca-fc8ea171bcf9 None None] MFA Rules not processed for user `fa831b66d72944dcbcd48e2542790f80`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:16.773784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5ee66a1a-170b-4961-bbca-fc8ea171bcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:16.834306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1117/2248] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:16.844600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:16.846304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:16.927243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca43a6-39e8-4abb-8132-9b8794e5605f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:16.931573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f26c6-fb49-41bc-b80c-cbda332606cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:16.932214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f26c6-fb49-41bc-b80c-cbda332606cc service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:16.932494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f26c6-fb49-41bc-b80c-cbda332606cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:16.932765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f26c6-fb49-41bc-b80c-cbda332606cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:16.940898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f26c6-fb49-41bc-b80c-cbda332606cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:16.942307 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f26c6-fb49-41bc-b80c-cbda332606cc service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:16.951474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1132/2249] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:10:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:10:33.207740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66a1a-170b-4961-bbca-fc8ea171bcf9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:33.270037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66a1a-170b-4961-bbca-fc8ea171bcf9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:33.274709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:33.275580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:33.275859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:33.276310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] PATH_INFO: `/v3/users/fa831b66d72944dcbcd48e2542790f80` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:33.277516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa831b66d72944dcbcd48e2542790f80)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:33.279415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:33.328873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa831b66d72944dcbcd48e2542790f80'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:33.335822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa831b66d72944dcbcd48e2542790f80'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:33.336459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa831b66d72944dcbcd48e2542790f80'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:33.337060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa831b66d72944dcbcd48e2542790f80'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:33.344284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa831b66d72944dcbcd48e2542790f80'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:33.361573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1118/2250] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:10:33 2022] DELETE /identity/v3/users/fa831b66d72944dcbcd48e2542790f80 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:10:33.366158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:33.367310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:33.367777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:33.384608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:33.385835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:33.449758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1133/2251] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:10:33.461109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:33.462515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:33.526729 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad380de-e914-4fff-bd81-3e5255f39102 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:33.531356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ffe8c-cc6c-4236-afdc-62f1c59e074c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:33.531994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ffe8c-cc6c-4236-afdc-62f1c59e074c service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:33.532274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ffe8c-cc6c-4236-afdc-62f1c59e074c service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:33.532542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ffe8c-cc6c-4236-afdc-62f1c59e074c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:33.543133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ffe8c-cc6c-4236-afdc-62f1c59e074c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:33.544565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ffe8c-cc6c-4236-afdc-62f1c59e074c service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:33.554737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1119/2252] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:10:34.155353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.157096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:34.170623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111533c-4fbe-4132-a1f7-8dd82c8b1a0b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.179212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.180140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.180678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.181360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] PATH_INFO: `/v3/projects/147cef469ddf40ce94d40fa65989ee10` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.183280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=147cef469ddf40ce94d40fa65989ee10)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.186097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.251572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147cef469ddf40ce94d40fa65989ee10', 'request_id': 'req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:34.261091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147cef469ddf40ce94d40fa65989ee10', 'request_id': 'req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:34.267172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147cef469ddf40ce94d40fa65989ee10', 'request_id': 'req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:34.279650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] The token cache is being invalidate because project 147cef469ddf40ce94d40fa65989ee10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:10:34.279971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:34.280584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-45d4c6cb-d58c-46f9-a263-6482abb3d1bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:34.282171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1134/2253] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:10:34 2022] DELETE /identity/v3/projects/147cef469ddf40ce94d40fa65989ee10 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:10:34.287134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46526-f878-4d52-a4a2-8d87b6df18e2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.287614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46526-f878-4d52-a4a2-8d87b6df18e2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.288214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46526-f878-4d52-a4a2-8d87b6df18e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.305395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-feb46526-f878-4d52-a4a2-8d87b6df18e2 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:34.307335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-feb46526-f878-4d52-a4a2-8d87b6df18e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:34.371716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1120/2254] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:10:34.379178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ad7dc-ea23-49dc-85a3-e1e48ef67c44 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.379630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ad7dc-ea23-49dc-85a3-e1e48ef67c44 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.379720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ad7dc-ea23-49dc-85a3-e1e48ef67c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.398664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-aa3ad7dc-ea23-49dc-85a3-e1e48ef67c44 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:34.399884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-aa3ad7dc-ea23-49dc-85a3-e1e48ef67c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:34.410145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1135/2255] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:34.414809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46526-f878-4d52-a4a2-8d87b6df18e2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.424931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46526-f878-4d52-a4a2-8d87b6df18e2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.429575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780ac8-ca7d-4138-9e03-18627b40c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.430179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780ac8-ca7d-4138-9e03-18627b40c10d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.430455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780ac8-ca7d-4138-9e03-18627b40c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.430731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780ac8-ca7d-4138-9e03-18627b40c10d admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.431455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780ac8-ca7d-4138-9e03-18627b40c10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:10:34.431761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780ac8-ca7d-4138-9e03-18627b40c10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.433341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780ac8-ca7d-4138-9e03-18627b40c10d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.448259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1121/2256] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:10:34.450210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ad7dc-ea23-49dc-85a3-e1e48ef67c44 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.461167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ad7dc-ea23-49dc-85a3-e1e48ef67c44 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.466368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.467228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.467535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.467750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.468691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.470884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.485073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b588-a0e8-4971-9735-47a634928e71 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.485362 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b588-a0e8-4971-9735-47a634928e71 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.485681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b588-a0e8-4971-9735-47a634928e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.502837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1136/2257] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:10:34 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:10:34.503881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.506253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b474b588-a0e8-4971-9735-47a634928e71 None None] MFA Rules not processed for user `047fb46d1a764838bd8f8a44609a2e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:34.508071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b474b588-a0e8-4971-9735-47a634928e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:34.560041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1122/2258] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:10:34.563745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e74ebf-6165-47e1-bace-293e1dd72769 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.568620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.569290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.570216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.570492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.571171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.573067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.596631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1137/2259] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:10:34 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:10:34.597909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474b588-a0e8-4971-9735-47a634928e71 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.608854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474b588-a0e8-4971-9735-47a634928e71 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.614101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.614830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.615196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.615634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.616923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.618662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.632485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1123/2260] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:10:34.633853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.644161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3aed-af12-4c6b-8beb-5b5f06d6313f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.648912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea15a40-833b-467b-bac4-60a72be5cd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.649678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea15a40-833b-467b-bac4-60a72be5cd70 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.649966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea15a40-833b-467b-bac4-60a72be5cd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.650239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea15a40-833b-467b-bac4-60a72be5cd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.650958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea15a40-833b-467b-bac4-60a72be5cd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.652574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea15a40-833b-467b-bac4-60a72be5cd70 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.662556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1138/2261] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:10:34.666640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.676457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a2fa-1933-45f0-8296-b7790f5d72b2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.681702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.682516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.682791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.683058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] PATH_INFO: `/v3/projects/5e46cb16860144dcbface3391cf06623/users/5237db693a0e468aa903bf147b732836/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.698213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e46cb16860144dcbface3391cf06623, user_id=5237db693a0e468aa903bf147b732836, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.700893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.714025 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1124/2262] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:10:34 2022] PUT /identity/v3/projects/5e46cb16860144dcbface3391cf06623/users/5237db693a0e468aa903bf147b732836/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:10:34.728034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7c5f-d621-437e-8c6c-7c030e3b5ef6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.728301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7c5f-d621-437e-8c6c-7c030e3b5ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.728589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7c5f-d621-437e-8c6c-7c030e3b5ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.761327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-015b7c5f-d621-437e-8c6c-7c030e3b5ef6 None None] MFA Rules not processed for user `5237db693a0e468aa903bf147b732836`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:34.762579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-015b7c5f-d621-437e-8c6c-7c030e3b5ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:34.826449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1139/2263] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:34.837590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:34.839973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:34.899042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc5c1c-2b97-4071-b76f-5011a8f95895 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:34.904145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c867fa-f534-4511-b5bb-559427e15a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:34.904900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c867fa-f534-4511-b5bb-559427e15a7a service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:34.905091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c867fa-f534-4511-b5bb-559427e15a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:34.905899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c867fa-f534-4511-b5bb-559427e15a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:34.915313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c867fa-f534-4511-b5bb-559427e15a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:34.916826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c867fa-f534-4511-b5bb-559427e15a7a service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:34.928524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1125/2264] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:10:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:10:42.040858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7c5f-d621-437e-8c6c-7c030e3b5ef6 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:42.119769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7c5f-d621-437e-8c6c-7c030e3b5ef6 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:42.124441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:42.125302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:42.125641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:42.125909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] PATH_INFO: `/v3/users/5237db693a0e468aa903bf147b732836` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:42.127086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5237db693a0e468aa903bf147b732836)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:42.129005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:42.182333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5237db693a0e468aa903bf147b732836'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:42.191991 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5237db693a0e468aa903bf147b732836'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:42.192722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5237db693a0e468aa903bf147b732836'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:42.202245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5237db693a0e468aa903bf147b732836'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:42.202947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5237db693a0e468aa903bf147b732836'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:42.223739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1140/2265] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:10:42 2022] DELETE /identity/v3/users/5237db693a0e468aa903bf147b732836 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:10:42.228575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4163d-1d7e-4395-a996-3829fae58ee1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:42.229061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4163d-1d7e-4395-a996-3829fae58ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:42.229178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4163d-1d7e-4395-a996-3829fae58ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:42.249657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-42f4163d-1d7e-4395-a996-3829fae58ee1 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:42.251606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-42f4163d-1d7e-4395-a996-3829fae58ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:42.326554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1126/2266] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:42.337027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:42.338805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:42.424494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a803fbb-6b35-4da9-a173-ac38678be6b6 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:42.430546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:42.434052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:42.434616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:42.435120 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:42.447334 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:42.449048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:42.459411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1141/2267] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:10:42.884619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaac5d-53ff-4a4b-94a6-b7c5bea088f9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:42.884911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaac5d-53ff-4a4b-94a6-b7c5bea088f9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:42.885187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaac5d-53ff-4a4b-94a6-b7c5bea088f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:42.903318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f8aaac5d-53ff-4a4b-94a6-b7c5bea088f9 None None] MFA Rules not processed for user `98211cfafca84542a64f8b3f0b34303b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:42.904523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f8aaac5d-53ff-4a4b-94a6-b7c5bea088f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:42.954126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:42.957300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:42.971192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1127/2268] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:10:42.981217 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5055ac7-de9c-4d68-bb31-d6700e2884aa service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:42.986206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:42.987148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:42.987500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:42.987842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] PATH_INFO: `/v3/projects/5e46cb16860144dcbface3391cf06623` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:42.989179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e46cb16860144dcbface3391cf06623)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:42.991248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.039224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e46cb16860144dcbface3391cf06623', 'request_id': 'req-1c9228f0-dce1-4212-a31b-3753b848ea0f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:43.047501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e46cb16860144dcbface3391cf06623', 'request_id': 'req-1c9228f0-dce1-4212-a31b-3753b848ea0f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:43.053078 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e46cb16860144dcbface3391cf06623', 'request_id': 'req-1c9228f0-dce1-4212-a31b-3753b848ea0f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:43.064641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] The token cache is being invalidate because project 5e46cb16860144dcbface3391cf06623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:10:43.064931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:43.065646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1c9228f0-dce1-4212-a31b-3753b848ea0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:10:43.067201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1142/2269] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:10:42 2022] DELETE /identity/v3/projects/5e46cb16860144dcbface3391cf06623 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:10:43.072662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03b84-a269-473c-8784-d77cb483ec31 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.072976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03b84-a269-473c-8784-d77cb483ec31 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.073342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03b84-a269-473c-8784-d77cb483ec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.091821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5ec03b84-a269-473c-8784-d77cb483ec31 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:43.093012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5ec03b84-a269-473c-8784-d77cb483ec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:43.154684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1128/2270] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:43.162704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cefc01-9f6a-4556-85b2-d687d8093bb6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.163064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cefc01-9f6a-4556-85b2-d687d8093bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.163400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cefc01-9f6a-4556-85b2-d687d8093bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.181297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-97cefc01-9f6a-4556-85b2-d687d8093bb6 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:43.182633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-97cefc01-9f6a-4556-85b2-d687d8093bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:43.190792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1143/2271] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:43.195760 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03b84-a269-473c-8784-d77cb483ec31 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:43.205161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03b84-a269-473c-8784-d77cb483ec31 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:43.210639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:43.211297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.211574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.211989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.212862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:10:43.213173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:43.214788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.226453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1129/2272] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:10:43.230480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cefc01-9f6a-4556-85b2-d687d8093bb6 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:43.239733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cefc01-9f6a-4556-85b2-d687d8093bb6 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:43.244496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:43.245220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.245524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.245797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.246478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:43.248485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.277554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1144/2273] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:10:43 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:10:43.279063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:43.289546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5309806-bea7-4d68-a7dc-dc08adde6790 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:43.352537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:43.353124 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.353551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.353834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.369086 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:43.371723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.401635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1130/2274] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:10:43 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:10:43.405535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:43.417309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a387d9-61e8-456c-a016-40b47b2b01a8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:43.422872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:43.424067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.424679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.425228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.426187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:43.428082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.442131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1145/2275] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:10:43.452376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:43.468477 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a384b6c-5f12-49b4-a1c5-9249ec81d54e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:43.473361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd73f2-4ef8-432d-9640-d0bbd7b63ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:43.474093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd73f2-4ef8-432d-9640-d0bbd7b63ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.474373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd73f2-4ef8-432d-9640-d0bbd7b63ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.474649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd73f2-4ef8-432d-9640-d0bbd7b63ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.475420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd73f2-4ef8-432d-9640-d0bbd7b63ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:43.477031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd73f2-4ef8-432d-9640-d0bbd7b63ef0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.487321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1131/2276] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:10:43.492351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:43.501819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d9b59-52a7-4214-903f-b1e7ca7e286f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:43.507336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:43.508285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.508566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.508842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] PATH_INFO: `/v3/projects/157e9c40125e42b4b5a908fc58bfa939/users/3c8b295066bc4ae695f6e60b9b3dc5dd/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.525248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157e9c40125e42b4b5a908fc58bfa939, user_id=3c8b295066bc4ae695f6e60b9b3dc5dd, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:43.528338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.549653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1146/2277] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:10:43 2022] PUT /identity/v3/projects/157e9c40125e42b4b5a908fc58bfa939/users/3c8b295066bc4ae695f6e60b9b3dc5dd/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:10:43.551879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5bf39-50b2-46e7-9d55-dc6429ad1e72 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.552348 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5bf39-50b2-46e7-9d55-dc6429ad1e72 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.552608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5bf39-50b2-46e7-9d55-dc6429ad1e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.581283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-39e5bf39-50b2-46e7-9d55-dc6429ad1e72 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:43.583049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-39e5bf39-50b2-46e7-9d55-dc6429ad1e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:43.687049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1132/2278] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:43.696432 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:43.698191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:43.759642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621aacb-6fc6-4c4e-b4d3-89d4b7f55cd9 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:43.763401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:43.764042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:43.764346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:43.764582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:43.774111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:43.775540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:43.785348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1147/2279] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:10:48.593354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2882fb-5bf6-4fa3-ab70-bd5341ea1e9a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:48.593831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2882fb-5bf6-4fa3-ab70-bd5341ea1e9a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:48.593933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2882fb-5bf6-4fa3-ab70-bd5341ea1e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:48.636614 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6c2882fb-5bf6-4fa3-ab70-bd5341ea1e9a None None] MFA Rules not processed for user `3c8b295066bc4ae695f6e60b9b3dc5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:48.637852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6c2882fb-5bf6-4fa3-ab70-bd5341ea1e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:48.726357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1133/2280] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:48.730616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:48.745869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bc94-407d-493f-a7be-1d976c178f59 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:48.751383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:48.752263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:48.752833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:48.753390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:48.754292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:48.757072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:48.791053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1148/2281] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:10:48 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:10:48.795005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2882fb-5bf6-4fa3-ab70-bd5341ea1e9a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:48.808535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2882fb-5bf6-4fa3-ab70-bd5341ea1e9a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:48.878440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:48.879131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:48.879405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:48.879854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:48.881884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:48.884840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:48.922129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1134/2282] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:10:48 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:10:48.925819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:48.940379 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863810cd-ae9b-4d8b-b3c3-4d9a1e7fb971 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:48.967651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:48.969008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:48.969501 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:48.970075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:48.971040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:48.972942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:49.010432 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1149/2283] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:10:49.010759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:49.025137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8125ba-6f22-4402-8503-ef0fc536882f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:49.034191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:49.035099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:49.035381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:49.035655 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] PATH_INFO: `/v3/projects/d3852d9773ae4f8d9747fa6de2cff3aa/users/1c9024a355504f07a760bcb6c2a79b6e/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:49.079770 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3852d9773ae4f8d9747fa6de2cff3aa, user_id=1c9024a355504f07a760bcb6c2a79b6e, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:49.083490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:49.113700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1135/2284] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:10:49 2022] PUT /identity/v3/projects/d3852d9773ae4f8d9747fa6de2cff3aa/users/1c9024a355504f07a760bcb6c2a79b6e/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:10:49.114999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:49.132687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7dd6-ab6e-4bfe-8dbc-40990f63ad3c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:49.251003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c06b1-37db-4757-bd12-42cb29bdf345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:49.251959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c06b1-37db-4757-bd12-42cb29bdf345 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:49.252401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c06b1-37db-4757-bd12-42cb29bdf345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:49.252768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c06b1-37db-4757-bd12-42cb29bdf345 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:49.253673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c06b1-37db-4757-bd12-42cb29bdf345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:49.255637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c06b1-37db-4757-bd12-42cb29bdf345 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:49.268638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1150/2285] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:10:49.273070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:49.285539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923df8b-f7a8-4edb-a506-2e536a28c3ab admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:49.298142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:49.299402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:49.299784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:49.300283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] PATH_INFO: `/v3/projects/d3852d9773ae4f8d9747fa6de2cff3aa/users/1c9024a355504f07a760bcb6c2a79b6e/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:49.304490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3852d9773ae4f8d9747fa6de2cff3aa, user_id=1c9024a355504f07a760bcb6c2a79b6e, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:49.315874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:49.328122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1136/2286] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:10:49 2022] PUT /identity/v3/projects/d3852d9773ae4f8d9747fa6de2cff3aa/users/1c9024a355504f07a760bcb6c2a79b6e/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:10:56.456954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759307-33e4-4d01-84a9-c670a159f06c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:56.457515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759307-33e4-4d01-84a9-c670a159f06c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:56.457515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759307-33e4-4d01-84a9-c670a159f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:56.484442 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-a3759307-33e4-4d01-84a9-c670a159f06c None None] MFA Rules not processed for user `1c9024a355504f07a760bcb6c2a79b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:56.487267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-a3759307-33e4-4d01-84a9-c670a159f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:56.579268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1151/2287] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:10:56.591524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:56.593578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:56.741071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce667-a6bd-456a-8af9-14804cf4a074 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:56.759253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7a1c-db71-4888-a54b-2d8ccdb5809a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:56.759905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7a1c-db71-4888-a54b-2d8ccdb5809a service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:56.760196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7a1c-db71-4888-a54b-2d8ccdb5809a service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:56.760511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7a1c-db71-4888-a54b-2d8ccdb5809a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:56.830812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7a1c-db71-4888-a54b-2d8ccdb5809a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:56.832581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7a1c-db71-4888-a54b-2d8ccdb5809a service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:56.845304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1137/2288] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:10:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:10:58.372071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169661bf-7631-41dd-a5c2-10332181ade4 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:58.372515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169661bf-7631-41dd-a5c2-10332181ade4 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:58.372826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169661bf-7631-41dd-a5c2-10332181ade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:58.399926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-169661bf-7631-41dd-a5c2-10332181ade4 None None] MFA Rules not processed for user `d54ad9809c8241a18d88fa6cd960badd`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:10:58.402073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-169661bf-7631-41dd-a5c2-10332181ade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:58.519158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1152/2289] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:10:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:11:04.537049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:04.538138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:04.538258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:04.555880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] MFA Rules not processed for user `47deb39e5d954424a4fb4e97375443f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:11:04.557094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:04.612421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1138/2290] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:11:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:11:11.370879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169661bf-7631-41dd-a5c2-10332181ade4 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:11.431546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169661bf-7631-41dd-a5c2-10332181ade4 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:11.435083 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b70dff-ae02-4fcc-bfcb-d2604afd7573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:11.435723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b70dff-ae02-4fcc-bfcb-d2604afd7573 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:11.436003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b70dff-ae02-4fcc-bfcb-d2604afd7573 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:11.436276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b70dff-ae02-4fcc-bfcb-d2604afd7573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:11.438062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f1b70dff-ae02-4fcc-bfcb-d2604afd7573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:11.451482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b70dff-ae02-4fcc-bfcb-d2604afd7573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:11.452965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b70dff-ae02-4fcc-bfcb-d2604afd7573 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:11.464341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1153/2291] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:12.639988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:12.641762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:12.654005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a784982-a222-4fc6-8c3f-f005d8398dc2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:12.657504 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:12.658145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:12.658422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:12.658693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:12.660377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:12.673478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:12.674891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:12.685270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1139/2292] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:15.396607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:15.397121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:15.397219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:15.414988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] MFA Rules not processed for user `3c8b295066bc4ae695f6e60b9b3dc5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:11:15.416720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:15.423722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1154/2293] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:11:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:11:15.735473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:15.743876 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffaf4b-ea89-4b59-9b45-d9d1e2d03c46 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:15.747768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:15.748532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:15.748818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:15.749087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:15.750870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:15.761099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:15.762546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:15.771296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1140/2294] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:16.449865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:16.451266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:16.528614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f31840-a8e0-44af-a9fe-e613f301e49c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:16.533549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:16.534192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:16.534471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:16.534742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:16.536521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:16.548172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:16.549780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:16.559890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1155/2295] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:32.902304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:32.910512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8146a9-c354-439e-9ff0-e5e70c6d20b8 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:32.914069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:32.914691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:32.914967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:32.915238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:32.923914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:32.925273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:32.934818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1141/2296] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:34.715595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:34.724530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abae8d-4513-4145-9576-3c7c2b198716 service placement] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:34.728064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:34.728695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:34.728972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:34.729250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:34.731495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:34.740842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:34.742290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:34.751341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1156/2297] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:11:34.886665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:34.898671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b194-b3ea-4a17-97dc-3685b6e7d04b service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:34.905789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:34.906440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:34.906716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:34.906993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:34.908796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:34.980564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:34.982246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:34.992076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1142/2298] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:51.484977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:51.486399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:51.540500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b775feb-35ec-4051-9530-361727574693 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:51.544081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:51.544720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:51.545000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:51.545277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:51.547042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:51.558114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:51.559530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:51.568254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1157/2299] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:56.089442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:56.091022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:56.104913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87fb5-3d55-465c-acf8-07a982bc75a3 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:56.110420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5524b57-1189-4bd8-bc37-c055950216f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:56.111109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5524b57-1189-4bd8-bc37-c055950216f5 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:56.111429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5524b57-1189-4bd8-bc37-c055950216f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:56.111743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5524b57-1189-4bd8-bc37-c055950216f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:56.113628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e5524b57-1189-4bd8-bc37-c055950216f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:56.127718 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5524b57-1189-4bd8-bc37-c055950216f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:56.129330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5524b57-1189-4bd8-bc37-c055950216f5 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:56.140587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1143/2300] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:57.950322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:57.962481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ea764-5f33-4280-a5f8-450426dbb4e3 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:57.967918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:57.968550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:57.968826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:57.969115 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:57.970908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:57.981731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:57.983294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:57.991892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1158/2301] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:11:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:00.284399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38e85-1f87-4db5-99ce-a4fdccf90e69 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:00.284924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38e85-1f87-4db5-99ce-a4fdccf90e69 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:00.285027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38e85-1f87-4db5-99ce-a4fdccf90e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:00.303905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-97b38e85-1f87-4db5-99ce-a4fdccf90e69 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:00.305330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-97b38e85-1f87-4db5-99ce-a4fdccf90e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:00.366707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1144/2302] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:12:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:00.423414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:00.425624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:00.517418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cf871-09b5-40ae-880d-ebd2ab304287 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:00.524422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:00.525087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:00.525366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:00.525677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:00.538453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:00.540728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:00.565726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1159/2303] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:12:00.966033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38e85-1f87-4db5-99ce-a4fdccf90e69 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:00.992299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38e85-1f87-4db5-99ce-a4fdccf90e69 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:01.011334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c191d-de3f-48ef-99d5-5b892590c22f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:01.012090 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c191d-de3f-48ef-99d5-5b892590c22f service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:01.012372 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c191d-de3f-48ef-99d5-5b892590c22f service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:01.012937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c191d-de3f-48ef-99d5-5b892590c22f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:01.020454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-518c191d-de3f-48ef-99d5-5b892590c22f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:01.067818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c191d-de3f-48ef-99d5-5b892590c22f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:01.070183 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c191d-de3f-48ef-99d5-5b892590c22f service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:01.093575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1145/2304] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:01.468776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:01.481272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0436c5-ac17-4928-b453-7530ce71c714 service swift] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:01.488031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:01.488893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:01.489355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:01.489824 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:01.491788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:01.520004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:01.521966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:01.552637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1160/2305] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:05.827471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:05.828071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:05.828164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:05.854186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] MFA Rules not processed for user `98211cfafca84542a64f8b3f0b34303b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:05.855926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:05.976862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1146/2306] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:17.429602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:17.440926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616947f-daab-468f-af7c-01c2f9c5fe71 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:17.444807 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:17.445592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:17.446084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:17.447591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:17.449643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:17.531016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:17.532455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:17.542719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1161/2307] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:21.320494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:21.322777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:21.346324 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bba2c4-169b-40a6-b997-5c49e9460ba3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:21.352260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:21.354099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:21.354536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:21.354962 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] PATH_INFO: `/v3/users/47deb39e5d954424a4fb4e97375443f7` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:21.356425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47deb39e5d954424a4fb4e97375443f7)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:21.359893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:21.431147 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47deb39e5d954424a4fb4e97375443f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:21.445079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47deb39e5d954424a4fb4e97375443f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:21.450023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47deb39e5d954424a4fb4e97375443f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:21.451355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47deb39e5d954424a4fb4e97375443f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:21.461716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c5d91dde-820a-47ed-9130-b680e4c33527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47deb39e5d954424a4fb4e97375443f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:21.492652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1147/2308] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:12:21 2022] DELETE /identity/v3/users/47deb39e5d954424a4fb4e97375443f7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:21.969972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:21.981789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1029-fe7b-4309-b7c5-50ef9dca394e service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.054294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.055377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.055965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.056909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] PATH_INFO: `/v3/projects/5966de1f7fc9403087d0ec08be6a3085` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.058684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5966de1f7fc9403087d0ec08be6a3085)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.061142 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.098234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.098517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.098862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.116805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:22.118170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:22.121367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5966de1f7fc9403087d0ec08be6a3085', 'request_id': 'req-320d99a9-4f11-4e19-9d5a-f095f85ea918'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:22.136333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5966de1f7fc9403087d0ec08be6a3085', 'request_id': 'req-320d99a9-4f11-4e19-9d5a-f095f85ea918'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:22.147579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5966de1f7fc9403087d0ec08be6a3085', 'request_id': 'req-320d99a9-4f11-4e19-9d5a-f095f85ea918'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:22.163246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] The token cache is being invalidate because project 5966de1f7fc9403087d0ec08be6a3085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:12:22.163784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:22.164755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-320d99a9-4f11-4e19-9d5a-f095f85ea918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:22.167447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1162/2309] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:12:21 2022] DELETE /identity/v3/projects/5966de1f7fc9403087d0ec08be6a3085 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:22.172053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef041-3aa7-4635-869c-ee8f4e42c5c9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.172342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef041-3aa7-4635-869c-ee8f4e42c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.172615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef041-3aa7-4635-869c-ee8f4e42c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.197436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1148/2310] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:22.198400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-806ef041-3aa7-4635-869c-ee8f4e42c5c9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:22.199601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-806ef041-3aa7-4635-869c-ee8f4e42c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:22.212493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:22.215387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:22.277731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1163/2311] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:12:22.286880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bb4f2-3285-4e1e-ab52-abd21387bf0b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.287029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd420-6e7a-4d0c-b8c6-4bf4476c2a57 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.287431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd420-6e7a-4d0c-b8c6-4bf4476c2a57 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.287770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd420-6e7a-4d0c-b8c6-4bf4476c2a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.293747 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.294461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.294808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.295143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.312779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.314352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-cfadd420-6e7a-4d0c-b8c6-4bf4476c2a57 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:22.315363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.315729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cfadd420-6e7a-4d0c-b8c6-4bf4476c2a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:22.326987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1149/2312] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 19:12:22.331160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1164/2313] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:22.332119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:22.349263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b044af3-3b71-4da1-9993-88e2b8083ef6 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.355835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.356827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.357255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.357739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.358814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:12:22.359622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.362199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.377975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1150/2314] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:12:22.382579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadd420-6e7a-4d0c-b8c6-4bf4476c2a57 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:22.394180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadd420-6e7a-4d0c-b8c6-4bf4476c2a57 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.405885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.406668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.406948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.407219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.407903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.410145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.467352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1165/2315] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:12:22 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:22.468791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:22.504360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190a8c5-dd66-4b62-85a6-0af49a5df2bd admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.626423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.628100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.628840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.629325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.631027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.633892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.662524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1151/2316] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:12:22 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:22.667133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:22.682688 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf617f3-a0f4-458b-a959-97a2016bcd6b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.694404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.695914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.697504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.699510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.700994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.708875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.733199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1166/2317] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:22.734742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:22.749883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54074d5-5628-49b2-9d3d-d60a0e2b5492 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.774032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6fd4-576e-4b65-8966-e442e122efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.776289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6fd4-576e-4b65-8966-e442e122efae admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.776832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6fd4-576e-4b65-8966-e442e122efae admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.777785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6fd4-576e-4b65-8966-e442e122efae admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.779957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6fd4-576e-4b65-8966-e442e122efae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.781693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6fd4-576e-4b65-8966-e442e122efae admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.807875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1152/2318] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:22.811363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:22.822771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da969-a48d-4774-ae3b-77af5cb8ad9d admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:22.830001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:22.831373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.831806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.832247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] PATH_INFO: `/v3/projects/9189667a7f284900b9b40069b41bb6f9/users/a507b3a88687444dbdb040bb6e62e85b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.872052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9189667a7f284900b9b40069b41bb6f9, user_id=a507b3a88687444dbdb040bb6e62e85b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:22.877050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:22.928618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51d1de-c0db-4eb6-826a-d54566da2c5a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:22.928916 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51d1de-c0db-4eb6-826a-d54566da2c5a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:22.929191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51d1de-c0db-4eb6-826a-d54566da2c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:22.929683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1167/2319] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:12:22 2022] PUT /identity/v3/projects/9189667a7f284900b9b40069b41bb6f9/users/a507b3a88687444dbdb040bb6e62e85b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:23.012424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4e51d1de-c0db-4eb6-826a-d54566da2c5a None None] MFA Rules not processed for user `a507b3a88687444dbdb040bb6e62e85b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:23.013694 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4e51d1de-c0db-4eb6-826a-d54566da2c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:23.172487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1153/2320] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:23.176682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:23.329740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fe2d4-70a6-4c18-b240-13e8411c327f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:23.342543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:23.343868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:23.344246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:23.344693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:23.346153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:23.348486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:23.386832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1168/2321] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:12:23 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:23.390225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51d1de-c0db-4eb6-826a-d54566da2c5a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:23.411051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51d1de-c0db-4eb6-826a-d54566da2c5a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:23.477739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:23.479089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:23.479377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:23.479652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:23.480428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:23.482499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:23.524148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1154/2322] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:12:23 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:23.527754 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:23.537745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741e8d-3ac9-442c-a8bf-0e416c0caf94 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:23.543305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:23.543966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:23.544248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:23.544522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:23.545238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:23.546870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:23.558134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1169/2323] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:12:23.562386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:23.573851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4528-4e2e-4c3b-9019-b2ab6594518b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:23.580818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:23.581687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:23.581969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:23.582500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] PATH_INFO: `/v3/projects/a0d29e2797784af5878e79c527dca74f/users/cdc88b89a8f14b87ac67eed0dc3302d1/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:23.598565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d29e2797784af5878e79c527dca74f, user_id=cdc88b89a8f14b87ac67eed0dc3302d1, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:23.601247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:23.627332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1155/2324] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:12:23 2022] PUT /identity/v3/projects/a0d29e2797784af5878e79c527dca74f/users/cdc88b89a8f14b87ac67eed0dc3302d1/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:23.631030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:23.646595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8d11-6829-479c-b603-c690a0556ffd admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:23.754668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27066e4-17c2-436d-891f-b1a0e4b9d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:23.755370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27066e4-17c2-436d-891f-b1a0e4b9d18d admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:23.755653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27066e4-17c2-436d-891f-b1a0e4b9d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:23.755927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27066e4-17c2-436d-891f-b1a0e4b9d18d admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:23.756672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27066e4-17c2-436d-891f-b1a0e4b9d18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:23.758331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27066e4-17c2-436d-891f-b1a0e4b9d18d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:23.779527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1170/2325] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:23.780270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:23.800355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d440ab-8ca8-49ee-a0dd-c3bc2936f039 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:23.809797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:23.810986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:23.811421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:23.811858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] PATH_INFO: `/v3/projects/a0d29e2797784af5878e79c527dca74f/users/cdc88b89a8f14b87ac67eed0dc3302d1/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:23.818431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d29e2797784af5878e79c527dca74f, user_id=cdc88b89a8f14b87ac67eed0dc3302d1, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:23.821424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:23.846695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:23.847046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:23.847423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:23.848858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1156/2326] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:12:23 2022] PUT /identity/v3/projects/a0d29e2797784af5878e79c527dca74f/users/cdc88b89a8f14b87ac67eed0dc3302d1/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:12:23.877794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] MFA Rules not processed for user `cdc88b89a8f14b87ac67eed0dc3302d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:23.879161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:24.002884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1171/2327] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:24.016975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:24.019257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:24.103190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbe14-8e1f-4241-95e2-8874b989680f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:24.108261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3d55-5954-450b-a691-00f005589e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:24.108261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3d55-5954-450b-a691-00f005589e5f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:24.108261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3d55-5954-450b-a691-00f005589e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:24.108790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3d55-5954-450b-a691-00f005589e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:24.123967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3d55-5954-450b-a691-00f005589e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:24.126398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3d55-5954-450b-a691-00f005589e5f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:24.144239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1157/2328] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:24.268564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:24.270998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:24.291934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66c26a-1598-4602-b357-690da1ce2dcc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:24.298280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:24.299269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:24.299762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:24.300250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:24.375146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:24.376521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:24.394234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1172/2329] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:38.684980 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:38.685565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:38.685565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:38.703358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:38.704542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:38.762479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1158/2330] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 19:12:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:12:38.776276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:38.844148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b673123-b667-487f-a698-6bcb74b635c1 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:38.851050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:38.852130 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:38.852680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:38.853109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:38.863897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:38.865794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:38.876175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1173/2331] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:12:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:12:44.247879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:44.249268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:44.301819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90db27-fafd-4e5c-a60a-f489fc7b88b6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:44.305246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:44.306402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:44.306674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:44.306940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:44.308659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:44.367306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:44.369264 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:44.378397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1159/2332] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:47.800795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:47.802220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:47.817454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becad85-2f07-4cfe-80d4-7db800597605 service swift] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:47.821893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:47.822749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:47.823025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:47.823293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] PATH_INFO: `/v3/users/d54ad9809c8241a18d88fa6cd960badd` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:47.824473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54ad9809c8241a18d88fa6cd960badd)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:47.826431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:47.871234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54ad9809c8241a18d88fa6cd960badd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:47.878172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54ad9809c8241a18d88fa6cd960badd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:47.878855 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54ad9809c8241a18d88fa6cd960badd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:47.885422 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54ad9809c8241a18d88fa6cd960badd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:47.886071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-fcdc57cd-83e8-4681-b1c5-34dd1e7dbcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54ad9809c8241a18d88fa6cd960badd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:47.902967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1174/2333] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:12:47 2022] DELETE /identity/v3/users/d54ad9809c8241a18d88fa6cd960badd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:48.071223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.082042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28422f-898a-4523-b054-59645df10bb2 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.136384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.137219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.137533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.137802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] PATH_INFO: `/v3/projects/df8f18c943e24a3ab621f08fa24c596b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.139041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8f18c943e24a3ab621f08fa24c596b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.140931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.184909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8f18c943e24a3ab621f08fa24c596b', 'request_id': 'req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:48.189982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8f18c943e24a3ab621f08fa24c596b', 'request_id': 'req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:48.197268 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8f18c943e24a3ab621f08fa24c596b', 'request_id': 'req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:48.207580 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] The token cache is being invalidate because project df8f18c943e24a3ab621f08fa24c596b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:12:48.207859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:48.208460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8f4c05ee-f3f5-4ec7-b657-be2ce14d5dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:48.209977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1160/2334] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:12:48 2022] DELETE /identity/v3/projects/df8f18c943e24a3ab621f08fa24c596b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:48.215709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c72b5-893a-46ad-ac75-b028742cb503 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.216031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c72b5-893a-46ad-ac75-b028742cb503 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.216311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c72b5-893a-46ad-ac75-b028742cb503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.234878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f90c72b5-893a-46ad-ac75-b028742cb503 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:48.236095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f90c72b5-893a-46ad-ac75-b028742cb503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:48.293495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1175/2335] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:48.301323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4870ffe-1745-41f6-8904-ec7b723b756b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.301632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4870ffe-1745-41f6-8904-ec7b723b756b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.301908 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4870ffe-1745-41f6-8904-ec7b723b756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.319514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b4870ffe-1745-41f6-8904-ec7b723b756b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:48.320705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b4870ffe-1745-41f6-8904-ec7b723b756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:48.328946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1161/2336] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:48.333038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c72b5-893a-46ad-ac75-b028742cb503 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.343203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c72b5-893a-46ad-ac75-b028742cb503 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.347631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.348292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.348566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.349321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.350071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:12:48.350370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.351946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.362954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1176/2337] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:12:48.367043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4870ffe-1745-41f6-8904-ec7b723b756b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.376057 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4870ffe-1745-41f6-8904-ec7b723b756b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.380657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.381293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.381603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.381881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.382564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.384966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.419963 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1162/2338] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:12:48 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:48.423979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.433658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe574-6d1a-494b-b8dc-6ed5976c7cfe admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.489806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.490631 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.490980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.491338 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.492107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.494279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.514315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1177/2339] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:12:48 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:12:48.519353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.530001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ba09-9724-4458-bf08-112b3a2adfb3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.534756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.535486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.535834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.536196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.537010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.538648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.548634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1163/2340] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:48.552526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.562946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271081-1e62-4c73-ae0a-4313b37bfbe2 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.567567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7250-cde9-4bc0-bd32-a35fc6acb187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.568260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7250-cde9-4bc0-bd32-a35fc6acb187 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.568543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7250-cde9-4bc0-bd32-a35fc6acb187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.568818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7250-cde9-4bc0-bd32-a35fc6acb187 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.569602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7250-cde9-4bc0-bd32-a35fc6acb187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.571876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7250-cde9-4bc0-bd32-a35fc6acb187 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.582283 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1178/2341] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:48.586417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.596358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd7318-0b9e-4145-9e48-c0ddff0257fc admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.601295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.602405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.602685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.602985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] PATH_INFO: `/v3/projects/3621a1bbaf384d9d8f0c7fb4138d3818/users/b959d0619d994a6296e2328d99a0c9f7/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.616976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3621a1bbaf384d9d8f0c7fb4138d3818, user_id=b959d0619d994a6296e2328d99a0c9f7, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.620154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.632541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1164/2342] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:12:48 2022] PUT /identity/v3/projects/3621a1bbaf384d9d8f0c7fb4138d3818/users/b959d0619d994a6296e2328d99a0c9f7/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:48.644198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8f93-ac26-4d7a-89ef-dbce81df4a4e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.644490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8f93-ac26-4d7a-89ef-dbce81df4a4e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.644883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8f93-ac26-4d7a-89ef-dbce81df4a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.670169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5beb8f93-ac26-4d7a-89ef-dbce81df4a4e None None] MFA Rules not processed for user `b959d0619d994a6296e2328d99a0c9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:48.671435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5beb8f93-ac26-4d7a-89ef-dbce81df4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:48.732180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1179/2343] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:48.743707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:48.745331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:48.815018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7687f-81fe-43b0-b316-75df982b53f9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:48.820630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1d3a9-5f43-4776-8684-a6563a54283c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:48.821891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1d3a9-5f43-4776-8684-a6563a54283c service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:48.822168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1d3a9-5f43-4776-8684-a6563a54283c service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:48.822438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1d3a9-5f43-4776-8684-a6563a54283c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:48.829986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1d3a9-5f43-4776-8684-a6563a54283c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:48.831532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1d3a9-5f43-4776-8684-a6563a54283c service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:48.839996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1165/2344] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:58.181592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb8f93-ac26-4d7a-89ef-dbce81df4a4e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:58.239664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb8f93-ac26-4d7a-89ef-dbce81df4a4e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:58.244610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:58.245475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:58.245766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:58.246033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] PATH_INFO: `/v3/users/b959d0619d994a6296e2328d99a0c9f7` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:58.247192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b959d0619d994a6296e2328d99a0c9f7)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:58.249231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:58.295394 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b959d0619d994a6296e2328d99a0c9f7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.301924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b959d0619d994a6296e2328d99a0c9f7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.302579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b959d0619d994a6296e2328d99a0c9f7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.309252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b959d0619d994a6296e2328d99a0c9f7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.309892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b959d0619d994a6296e2328d99a0c9f7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.325963 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1180/2345] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:12:58 2022] DELETE /identity/v3/users/b959d0619d994a6296e2328d99a0c9f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:58.330560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:58.331076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:58.331186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:58.347838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:58.349012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:58.406390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1166/2346] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:58.417359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:58.419822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:58.474700 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89537f-b3a4-420c-bba1-90fe5b326af1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:58.480092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e0193-4f7e-469a-8229-8263da8b19f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:58.480738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e0193-4f7e-469a-8229-8263da8b19f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:58.481022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e0193-4f7e-469a-8229-8263da8b19f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:58.481291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e0193-4f7e-469a-8229-8263da8b19f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:58.491143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e0193-4f7e-469a-8229-8263da8b19f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:58.492725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e0193-4f7e-469a-8229-8263da8b19f6 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:58.502505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1181/2347] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:12:58.775897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:58.777313 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:58.789204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3c40b-4d93-4abb-ab5b-458bff4d5422 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:58.794107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:58.795184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:58.795459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:58.795893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] PATH_INFO: `/v3/projects/3621a1bbaf384d9d8f0c7fb4138d3818` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:58.797081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3621a1bbaf384d9d8f0c7fb4138d3818)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:58.799018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:58.843389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3621a1bbaf384d9d8f0c7fb4138d3818', 'request_id': 'req-545c9f6f-9743-4097-b894-5c12026e1973'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.848517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3621a1bbaf384d9d8f0c7fb4138d3818', 'request_id': 'req-545c9f6f-9743-4097-b894-5c12026e1973'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.854717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3621a1bbaf384d9d8f0c7fb4138d3818', 'request_id': 'req-545c9f6f-9743-4097-b894-5c12026e1973'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.865241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] The token cache is being invalidate because project 3621a1bbaf384d9d8f0c7fb4138d3818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:12:58.865539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.866162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-545c9f6f-9743-4097-b894-5c12026e1973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:12:58.867839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1167/2348] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:12:58 2022] DELETE /identity/v3/projects/3621a1bbaf384d9d8f0c7fb4138d3818 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:58.873669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec287cb-8071-47d1-a0d9-67207ab54a48 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:58.873955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec287cb-8071-47d1-a0d9-67207ab54a48 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:58.874230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec287cb-8071-47d1-a0d9-67207ab54a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:58.892464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8ec287cb-8071-47d1-a0d9-67207ab54a48 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:58.893674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8ec287cb-8071-47d1-a0d9-67207ab54a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:58.949519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1182/2349] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:58.957207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af1cc-0298-451c-a18c-c825089ccaf3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:58.957516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af1cc-0298-451c-a18c-c825089ccaf3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:58.957799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af1cc-0298-451c-a18c-c825089ccaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:58.976554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-709af1cc-0298-451c-a18c-c825089ccaf3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:58.977797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-709af1cc-0298-451c-a18c-c825089ccaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:58.985715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1168/2350] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:58.989869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec287cb-8071-47d1-a0d9-67207ab54a48 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:58.999231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec287cb-8071-47d1-a0d9-67207ab54a48 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.003674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.004311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.004584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.004853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.005599 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:12:59.005904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.007473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.019321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1183/2351] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:12:59.023215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709af1cc-0298-451c-a18c-c825089ccaf3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.032715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709af1cc-0298-451c-a18c-c825089ccaf3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.037304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.037968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.038249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.038522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.039222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.041099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.065596 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1169/2352] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:12:59 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:12:59.069630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.080496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7c40-ea5c-4318-85a3-3f8c72c7ebb2 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.137539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.138202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.138481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.138756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.139424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.141601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.161216 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1184/2353] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:12:59 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:59.165421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.175455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcae45-d8e7-4851-ada8-9f782f7143a1 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.180577 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.181224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.181529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.181808 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.182550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.184148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.194641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1170/2354] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:59.198946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.208565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb663f-ba1d-427a-86b2-99c241746d03 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.213238 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbd043-4345-45ed-9d68-5a6abb6478b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.213913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbd043-4345-45ed-9d68-5a6abb6478b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.214193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbd043-4345-45ed-9d68-5a6abb6478b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.214467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbd043-4345-45ed-9d68-5a6abb6478b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.215174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbd043-4345-45ed-9d68-5a6abb6478b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.216741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbd043-4345-45ed-9d68-5a6abb6478b1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.226827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1185/2355] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:59.230793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.240352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f6437-f77b-4d0c-acb3-a0410f65e41d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.245412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.246298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.246578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.246851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] PATH_INFO: `/v3/projects/85b08b06631a4d8e8c9dd284dda8d86a/users/f928dd9ea0f347578660fdb0e4ad93f6/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.261091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b08b06631a4d8e8c9dd284dda8d86a, user_id=f928dd9ea0f347578660fdb0e4ad93f6, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.263751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.276730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1171/2356] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:12:59 2022] PUT /identity/v3/projects/85b08b06631a4d8e8c9dd284dda8d86a/users/f928dd9ea0f347578660fdb0e4ad93f6/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:59.286604 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6774e-5a63-4093-a710-1a3011c53760 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.286967 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6774e-5a63-4093-a710-1a3011c53760 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.287215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6774e-5a63-4093-a710-1a3011c53760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.313601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3ff6774e-5a63-4093-a710-1a3011c53760 None None] MFA Rules not processed for user `f928dd9ea0f347578660fdb0e4ad93f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:59.314794 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3ff6774e-5a63-4093-a710-1a3011c53760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:59.375253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1186/2357] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:59.379602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.439754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871fc7-bc04-4a15-b3cf-e2193a9bb693 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.444360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.445006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.445286 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.445591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.446295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.448174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.471546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1172/2358] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:12:59 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:59.475536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6774e-5a63-4093-a710-1a3011c53760 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.486381 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6774e-5a63-4093-a710-1a3011c53760 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.540822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.541409 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.541716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.541992 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.542715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.544602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.564310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1187/2359] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:12:59 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:12:59.568263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.578462 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e2e3-6adf-43fe-b71c-3eab504155ad admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.583035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.583714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.583993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.584266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.584978 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.586615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.599326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1173/2360] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:59.604146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.617027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012384a7-8900-410a-b58e-2e03911bfef7 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.622456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.623339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.623620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.623892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] PATH_INFO: `/v3/projects/86597bfbb98247cf8f484935b56c1603/users/9d3b15c1f05645a7a941eca823c52bc0/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.638160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86597bfbb98247cf8f484935b56c1603, user_id=9d3b15c1f05645a7a941eca823c52bc0, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.640799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.654169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1188/2361] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:12:59 2022] PUT /identity/v3/projects/86597bfbb98247cf8f484935b56c1603/users/9d3b15c1f05645a7a941eca823c52bc0/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:59.658098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.668294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf2a73-101c-42d3-bd3d-d1450502cf52 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.721793 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a05c5-919c-44d8-8ec5-6bb4d3cca08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.722451 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a05c5-919c-44d8-8ec5-6bb4d3cca08a admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.722732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a05c5-919c-44d8-8ec5-6bb4d3cca08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.723014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a05c5-919c-44d8-8ec5-6bb4d3cca08a admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.723727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a05c5-919c-44d8-8ec5-6bb4d3cca08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.725318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a05c5-919c-44d8-8ec5-6bb4d3cca08a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.735607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1174/2362] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:12:59.739648 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.752272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee81a2a-a4bf-4468-ae1f-68c781acbd1e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.756953 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.757868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.758144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.758556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] PATH_INFO: `/v3/projects/86597bfbb98247cf8f484935b56c1603/users/9d3b15c1f05645a7a941eca823c52bc0/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.760483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86597bfbb98247cf8f484935b56c1603, user_id=9d3b15c1f05645a7a941eca823c52bc0, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:12:59.763199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:12:59.774619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1189/2363] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:12:59 2022] PUT /identity/v3/projects/86597bfbb98247cf8f484935b56c1603/users/9d3b15c1f05645a7a941eca823c52bc0/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:12:59.785995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.786371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.786833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:12:59.814519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] MFA Rules not processed for user `9d3b15c1f05645a7a941eca823c52bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:12:59.815709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:59.881347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1175/2364] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:12:59.893203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:12:59.895169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:12:59.964342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aec4f-cd12-46ed-8446-6806ae5bd49c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:12:59.968439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:12:59.969084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:12:59.969365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:12:59.969674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:00.028621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:00.030118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:00.038740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1190/2365] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:12:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:06.705951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:06.707331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:06.719228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b580f6-ec39-46aa-b945-6309e3cea17f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:06.723091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:06.723754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:06.724034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:06.724302 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:06.733712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:06.734914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:06.745335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1176/2366] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:06.932420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:06.933935 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:07.012121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a970f-4441-4303-816a-c298fffd3ce4 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:07.017829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b141c7-1cf1-4166-955a-bc5bdcc329f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:07.018477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b141c7-1cf1-4166-955a-bc5bdcc329f8 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:07.018758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b141c7-1cf1-4166-955a-bc5bdcc329f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:07.019032 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b141c7-1cf1-4166-955a-bc5bdcc329f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:07.021092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e4b141c7-1cf1-4166-955a-bc5bdcc329f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:07.086270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b141c7-1cf1-4166-955a-bc5bdcc329f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:07.087856 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b141c7-1cf1-4166-955a-bc5bdcc329f8 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:07.097010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1191/2367] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:08.102625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:08.104009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:08.164834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a626b9-b07f-40d7-aa76-8740003e57e5 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:08.169267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:08.170155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:08.170432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:08.170698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] PATH_INFO: `/v3/users/a507b3a88687444dbdb040bb6e62e85b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:08.171983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a507b3a88687444dbdb040bb6e62e85b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:08.173936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:08.217055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a507b3a88687444dbdb040bb6e62e85b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.224102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a507b3a88687444dbdb040bb6e62e85b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.224767 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a507b3a88687444dbdb040bb6e62e85b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.225427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a507b3a88687444dbdb040bb6e62e85b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.232031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a507b3a88687444dbdb040bb6e62e85b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.248704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1177/2368] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:08 2022] DELETE /identity/v3/users/a507b3a88687444dbdb040bb6e62e85b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:08.253235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:08.253735 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:08.253840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:08.271279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:08.272444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:08.331178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1192/2369] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:08.340813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:08.342217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:08.397659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4e0ef-7a91-4175-b920-778f236df86a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:08.401296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:08.401967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:08.402246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:08.402517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:08.411487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:08.412906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:08.424329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1178/2370] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:08.677633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:08.679048 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:08.692069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597b6d6-265a-49bf-87cf-141337d22eb3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:08.697550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:08.698309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:08.698486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:08.698763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] PATH_INFO: `/v3/projects/9189667a7f284900b9b40069b41bb6f9` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:08.699971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9189667a7f284900b9b40069b41bb6f9)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:08.702139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:08.746408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9189667a7f284900b9b40069b41bb6f9', 'request_id': 'req-bd401c9d-c94d-47ab-8a65-4c8962913e37'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.753124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9189667a7f284900b9b40069b41bb6f9', 'request_id': 'req-bd401c9d-c94d-47ab-8a65-4c8962913e37'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.758413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9189667a7f284900b9b40069b41bb6f9', 'request_id': 'req-bd401c9d-c94d-47ab-8a65-4c8962913e37'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.769010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] The token cache is being invalidate because project 9189667a7f284900b9b40069b41bb6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:08.769294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.769939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.771439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1193/2371] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:08 2022] DELETE /identity/v3/projects/9189667a7f284900b9b40069b41bb6f9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:08.775893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:08.785188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f16ce2-01d9-43e3-8351-bbf479745bcc service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:08.838028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:08.838874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:08.839150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:08.839417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] PATH_INFO: `/v3/users/cdc88b89a8f14b87ac67eed0dc3302d1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:08.840585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc88b89a8f14b87ac67eed0dc3302d1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:08.842534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:08.886174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc88b89a8f14b87ac67eed0dc3302d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.893340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc88b89a8f14b87ac67eed0dc3302d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.894059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc88b89a8f14b87ac67eed0dc3302d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.894845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc88b89a8f14b87ac67eed0dc3302d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.902335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5a95dce9-28eb-4ebf-ac08-6b120372f9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc88b89a8f14b87ac67eed0dc3302d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:08.919155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1179/2372] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:08 2022] DELETE /identity/v3/users/cdc88b89a8f14b87ac67eed0dc3302d1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:09.182647 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.184106 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:09.197369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd401c9d-c94d-47ab-8a65-4c8962913e37 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.252285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.253125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.253399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.254002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] PATH_INFO: `/v3/projects/a0d29e2797784af5878e79c527dca74f` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.254830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d29e2797784af5878e79c527dca74f)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.256712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.302668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d29e2797784af5878e79c527dca74f', 'request_id': 'req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:09.309779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d29e2797784af5878e79c527dca74f', 'request_id': 'req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:09.314928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d29e2797784af5878e79c527dca74f', 'request_id': 'req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:09.325932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] The token cache is being invalidate because project a0d29e2797784af5878e79c527dca74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:09.326213 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:09.326827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2d318f10-1e1e-440f-bf2e-62d6c48a62cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:09.328369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1194/2373] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:09 2022] DELETE /identity/v3/projects/a0d29e2797784af5878e79c527dca74f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:09.333189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd292e-f7c3-4cc8-b00a-13b1cff73d22 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.333812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd292e-f7c3-4cc8-b00a-13b1cff73d22 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.333812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd292e-f7c3-4cc8-b00a-13b1cff73d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.351849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-31cd292e-f7c3-4cc8-b00a-13b1cff73d22 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:09.353130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-31cd292e-f7c3-4cc8-b00a-13b1cff73d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:09.409185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1180/2374] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:09.418117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab46d-5eb6-4bf8-b0cf-54509928724d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.418391 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab46d-5eb6-4bf8-b0cf-54509928724d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.418676 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab46d-5eb6-4bf8-b0cf-54509928724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.437201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-050ab46d-5eb6-4bf8-b0cf-54509928724d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:09.438451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-050ab46d-5eb6-4bf8-b0cf-54509928724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:09.446817 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1195/2375] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:09.450961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd292e-f7c3-4cc8-b00a-13b1cff73d22 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.460358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd292e-f7c3-4cc8-b00a-13b1cff73d22 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.465509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.466157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.466433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.466705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.467423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:09.467725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.469312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.480548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1181/2376] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:09.484667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab46d-5eb6-4bf8-b0cf-54509928724d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.493799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab46d-5eb6-4bf8-b0cf-54509928724d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.498364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.499035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.499309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.499579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.500252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.502167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.527578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1196/2377] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:09.531539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.541144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369a5bf-3f6f-45ec-90ab-13d8d4b9df2c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.594336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.595103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.595383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.595652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.596356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.598384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.616658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1182/2378] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:09 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:09.621145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.631153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15431017-8161-45dc-ae72-1887788837a3 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.636702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.637354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.637662 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.637933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.638640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.640206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.651390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1197/2379] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:09.655484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.668018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654fee-a82b-48c5-93d4-dcdbae4ae630 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.673359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8210b6-1943-485e-a4cd-4c566ef58c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.674039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8210b6-1943-485e-a4cd-4c566ef58c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.674317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8210b6-1943-485e-a4cd-4c566ef58c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.674590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8210b6-1943-485e-a4cd-4c566ef58c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.675308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8210b6-1943-485e-a4cd-4c566ef58c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.676884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8210b6-1943-485e-a4cd-4c566ef58c54 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.687132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1183/2380] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:09.691082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.701286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b9b41-0510-41da-9ad5-ff20f6687360 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.706247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.707113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.707389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.707662 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] PATH_INFO: `/v3/projects/431f0245c7c44747810a613b773d847f/users/0dc2e7137b0244faa8ddcf8ae27a6554/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.721851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431f0245c7c44747810a613b773d847f, user_id=0dc2e7137b0244faa8ddcf8ae27a6554, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.724497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.736596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1198/2381] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:09 2022] PUT /identity/v3/projects/431f0245c7c44747810a613b773d847f/users/0dc2e7137b0244faa8ddcf8ae27a6554/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:09.747236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86988-445d-4b55-bb1d-6e2318ebf82f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.747526 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86988-445d-4b55-bb1d-6e2318ebf82f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.747801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86988-445d-4b55-bb1d-6e2318ebf82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.774921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4ae86988-445d-4b55-bb1d-6e2318ebf82f None None] MFA Rules not processed for user `0dc2e7137b0244faa8ddcf8ae27a6554`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:09.776171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4ae86988-445d-4b55-bb1d-6e2318ebf82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:09.837289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1184/2382] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:09.841954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.901758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df6ed-3d38-457d-92c8-83ac2c64bbc6 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:09.906348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:09.907001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:09.907282 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:09.907558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:09.908232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:09.910162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:09.935508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1199/2383] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:09 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:09.939866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae86988-445d-4b55-bb1d-6e2318ebf82f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:09.951430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae86988-445d-4b55-bb1d-6e2318ebf82f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:10.007959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:10.008630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.008912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.009188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.009909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:10.011821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:10.030588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1185/2384] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:09 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:10.034621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:10.045041 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131f51-3b7a-431d-bb85-edb39d0d63ea admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:10.049615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:10.050262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.050542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.050816 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.051526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:10.053101 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:10.064064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1200/2385] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:10.067707 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:10.077193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20994-37f0-416e-8a61-6add2ef95444 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:10.081690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:10.082545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.082842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.083111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] PATH_INFO: `/v3/projects/dbd0c7c0c35f4fd6b9a63217b4e65a2a/users/c6808dc35b154d00b5730f1b8bfba0be/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.097062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd0c7c0c35f4fd6b9a63217b4e65a2a, user_id=c6808dc35b154d00b5730f1b8bfba0be, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:10.099734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:10.112051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1186/2386] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:10 2022] PUT /identity/v3/projects/dbd0c7c0c35f4fd6b9a63217b4e65a2a/users/c6808dc35b154d00b5730f1b8bfba0be/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:10.115923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:10.126134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739ed1d-6169-49d9-92f2-67d8b2b26c6a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:10.181037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa24fa-5e2d-4011-b8c7-2f11f79cfa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:10.181733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa24fa-5e2d-4011-b8c7-2f11f79cfa83 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.181997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa24fa-5e2d-4011-b8c7-2f11f79cfa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.182262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa24fa-5e2d-4011-b8c7-2f11f79cfa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.182959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa24fa-5e2d-4011-b8c7-2f11f79cfa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:10.184521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa24fa-5e2d-4011-b8c7-2f11f79cfa83 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:10.193886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1201/2387] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:10.197995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:10.208187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13e76a-6c9a-4bdc-b285-b5f8336cab67 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:10.212704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:10.213656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.213934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.214203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] PATH_INFO: `/v3/projects/dbd0c7c0c35f4fd6b9a63217b4e65a2a/users/c6808dc35b154d00b5730f1b8bfba0be/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.216151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd0c7c0c35f4fd6b9a63217b4e65a2a, user_id=c6808dc35b154d00b5730f1b8bfba0be, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:10.218817 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:10.229043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1187/2388] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:10 2022] PUT /identity/v3/projects/dbd0c7c0c35f4fd6b9a63217b4e65a2a/users/c6808dc35b154d00b5730f1b8bfba0be/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:10.239257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aaa6f-dcee-4319-8a95-2f8852c95a1f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.239544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aaa6f-dcee-4319-8a95-2f8852c95a1f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.239820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aaa6f-dcee-4319-8a95-2f8852c95a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.266835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-752aaa6f-dcee-4319-8a95-2f8852c95a1f None None] MFA Rules not processed for user `c6808dc35b154d00b5730f1b8bfba0be`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:10.268020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-752aaa6f-dcee-4319-8a95-2f8852c95a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:10.343210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1202/2389] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:10.354890 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:10.356559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:10.409999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87215cb-5b6e-4aaa-b039-52042e894206 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:10.413594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567c8c9-5f0c-41f5-98f8-ee0268b1fccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:10.414225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c8c9-5f0c-41f5-98f8-ee0268b1fccf service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.415062 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c8c9-5f0c-41f5-98f8-ee0268b1fccf service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.415336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c8c9-5f0c-41f5-98f8-ee0268b1fccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.424214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567c8c9-5f0c-41f5-98f8-ee0268b1fccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:10.425653 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567c8c9-5f0c-41f5-98f8-ee0268b1fccf service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:10.434748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1188/2390] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:10.827812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aaa6f-dcee-4319-8a95-2f8852c95a1f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:10.896780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aaa6f-dcee-4319-8a95-2f8852c95a1f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:10.902415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:10.903380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.903653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.903921 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] PATH_INFO: `/v3/users/0dc2e7137b0244faa8ddcf8ae27a6554` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:10.905273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc2e7137b0244faa8ddcf8ae27a6554)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:10.907290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:10.954345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc2e7137b0244faa8ddcf8ae27a6554'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:10.960988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc2e7137b0244faa8ddcf8ae27a6554'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:10.962152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc2e7137b0244faa8ddcf8ae27a6554'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:10.969339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc2e7137b0244faa8ddcf8ae27a6554'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:10.970013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc2e7137b0244faa8ddcf8ae27a6554'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:10.986804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1203/2391] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:10 2022] DELETE /identity/v3/users/0dc2e7137b0244faa8ddcf8ae27a6554 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:10.991082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:10.991367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:10.991641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:11.009765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:11.010953 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:11.068921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1189/2392] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:11.079038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:11.080413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:11.134939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686854-34f6-4ef2-9078-ebed2574d225 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:11.138547 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:11.139175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:11.139451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:11.139719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:11.148522 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:11.150010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:11.159219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1204/2393] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:11.421199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:11.422685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:11.435329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27993-8cce-4da1-9549-c16ae64d0001 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:11.440869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:11.441894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:11.442174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:11.442603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] PATH_INFO: `/v3/projects/431f0245c7c44747810a613b773d847f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:11.443753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431f0245c7c44747810a613b773d847f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:11.445809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:11.493659 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431f0245c7c44747810a613b773d847f', 'request_id': 'req-0fb1af53-3c1e-4b9c-98ce-c502059154e8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.498833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431f0245c7c44747810a613b773d847f', 'request_id': 'req-0fb1af53-3c1e-4b9c-98ce-c502059154e8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.506558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431f0245c7c44747810a613b773d847f', 'request_id': 'req-0fb1af53-3c1e-4b9c-98ce-c502059154e8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.520078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] The token cache is being invalidate because project 431f0245c7c44747810a613b773d847f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:11.520491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.521377 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.522973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1190/2394] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:11 2022] DELETE /identity/v3/projects/431f0245c7c44747810a613b773d847f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:11.527050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:11.536565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def791c2-8c93-4897-9ff5-2bc3cce8cbcf service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:11.595818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:11.596753 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:11.597037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:11.597389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] PATH_INFO: `/v3/users/c6808dc35b154d00b5730f1b8bfba0be` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:11.598929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6808dc35b154d00b5730f1b8bfba0be)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:11.601194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:11.646612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6808dc35b154d00b5730f1b8bfba0be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.653527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6808dc35b154d00b5730f1b8bfba0be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.654193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6808dc35b154d00b5730f1b8bfba0be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.661931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6808dc35b154d00b5730f1b8bfba0be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.662931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f658e965-9ec0-46e3-b1fb-d57ebed59d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6808dc35b154d00b5730f1b8bfba0be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:11.681019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1205/2395] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:11 2022] DELETE /identity/v3/users/c6808dc35b154d00b5730f1b8bfba0be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:11.964561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:11.966008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:11.980542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1af53-3c1e-4b9c-98ce-c502059154e8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.036945 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.037839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.038126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.038399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] PATH_INFO: `/v3/projects/dbd0c7c0c35f4fd6b9a63217b4e65a2a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.040225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd0c7c0c35f4fd6b9a63217b4e65a2a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.042230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.084670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd0c7c0c35f4fd6b9a63217b4e65a2a', 'request_id': 'req-c6225fc8-a234-48b7-984a-8f201b0e2f24'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:12.090335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd0c7c0c35f4fd6b9a63217b4e65a2a', 'request_id': 'req-c6225fc8-a234-48b7-984a-8f201b0e2f24'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:12.096845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd0c7c0c35f4fd6b9a63217b4e65a2a', 'request_id': 'req-c6225fc8-a234-48b7-984a-8f201b0e2f24'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:12.108115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] The token cache is being invalidate because project dbd0c7c0c35f4fd6b9a63217b4e65a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:12.108418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:12.109034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c6225fc8-a234-48b7-984a-8f201b0e2f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:12.110556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1191/2396] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:11 2022] DELETE /identity/v3/projects/dbd0c7c0c35f4fd6b9a63217b4e65a2a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:12.115436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f237-50ac-473d-bc00-cd867aea5358 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.115721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f237-50ac-473d-bc00-cd867aea5358 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.115993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f237-50ac-473d-bc00-cd867aea5358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.134197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-16b1f237-50ac-473d-bc00-cd867aea5358 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:12.135380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-16b1f237-50ac-473d-bc00-cd867aea5358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:12.190366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1206/2397] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:12.199409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232827d-6955-4981-aa48-1e0db427d15a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.199695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232827d-6955-4981-aa48-1e0db427d15a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.199974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232827d-6955-4981-aa48-1e0db427d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.217925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3232827d-6955-4981-aa48-1e0db427d15a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:12.219097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3232827d-6955-4981-aa48-1e0db427d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:12.226781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1192/2398] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:12.230798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1f237-50ac-473d-bc00-cd867aea5358 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.240179 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1f237-50ac-473d-bc00-cd867aea5358 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.244684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.245323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.245635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.245903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.246609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:12.246908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.248476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.259995 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1207/2399] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:12.264171 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232827d-6955-4981-aa48-1e0db427d15a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.273068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232827d-6955-4981-aa48-1e0db427d15a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.278239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.278866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.279138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.279408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.280082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.282016 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.305801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1193/2400] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:12 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:12.309711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.319240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e2beb-c86d-4158-a24a-fdab587a47e3 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.376867 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.377713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.378152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.378318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.379027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.381100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.404304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1208/2401] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:12 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:12.405489 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.415818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93738e-364f-4add-bbb6-8cf3a4cb8faf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.420612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.421269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.421822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.421822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.422578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.424191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.436073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1194/2402] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:12.440022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.451325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73353a-ca79-44ca-8414-05d7d325b7da admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.456270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca60c1-b82e-4171-aaa3-1ba811426f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.456930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca60c1-b82e-4171-aaa3-1ba811426f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.457205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca60c1-b82e-4171-aaa3-1ba811426f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.457563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca60c1-b82e-4171-aaa3-1ba811426f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.458220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca60c1-b82e-4171-aaa3-1ba811426f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.459790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca60c1-b82e-4171-aaa3-1ba811426f7a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.470583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1209/2403] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:12.474688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.484581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1aafc-266c-47a1-b2cb-27c9f67210d6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.489647 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.490693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.490922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.491237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] PATH_INFO: `/v3/projects/eb7119b4f1e0424ca770b32006d082c5/users/d704e2455ad24c2fa2340e7fdc49dcc1/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.508550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7119b4f1e0424ca770b32006d082c5, user_id=d704e2455ad24c2fa2340e7fdc49dcc1, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.512468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.529509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1195/2404] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:12 2022] PUT /identity/v3/projects/eb7119b4f1e0424ca770b32006d082c5/users/d704e2455ad24c2fa2340e7fdc49dcc1/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:12.539880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e92aa-a0e6-4c18-8ed5-cdc830d64823 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.540376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e92aa-a0e6-4c18-8ed5-cdc830d64823 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.540480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e92aa-a0e6-4c18-8ed5-cdc830d64823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.568801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3b8e92aa-a0e6-4c18-8ed5-cdc830d64823 None None] MFA Rules not processed for user `d704e2455ad24c2fa2340e7fdc49dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:12.569946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3b8e92aa-a0e6-4c18-8ed5-cdc830d64823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:12.649412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1210/2405] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:12.653947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.714437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9088ef-55fe-4ef2-bb4f-621dffe51746 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.719010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.719650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.719925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.720193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.720856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.722763 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.746371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1196/2406] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:12 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:12.750574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e92aa-a0e6-4c18-8ed5-cdc830d64823 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.762189 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e92aa-a0e6-4c18-8ed5-cdc830d64823 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.815333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.815993 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.816272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.816545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.817215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.819195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.838496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1211/2407] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:12 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:12.842473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.852379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e37af-2d8c-4863-8344-f38de6b1b135 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.856912 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.857588 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.857867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.858136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.858841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.860407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.870875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1197/2408] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:12.874755 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.885076 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc993b91-8e54-42b3-9994-7d1a63dd2ba6 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.889652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.890521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.890828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.891357 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] PATH_INFO: `/v3/projects/20f878c5ccd2471bb9bec88d797f3e06/users/7bd2b4340d964c7c93b60ad0d66ee74c/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.905339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f878c5ccd2471bb9bec88d797f3e06, user_id=7bd2b4340d964c7c93b60ad0d66ee74c, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.907989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:12.920279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1212/2409] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:12 2022] PUT /identity/v3/projects/20f878c5ccd2471bb9bec88d797f3e06/users/7bd2b4340d964c7c93b60ad0d66ee74c/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:12.924081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:12.934364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672504d-9a8c-4f85-8e37-44271dddd7ea admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:12.989870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffaebc-4c70-4cf2-8fef-34f90f910ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:12.990534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffaebc-4c70-4cf2-8fef-34f90f910ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:12.990810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffaebc-4c70-4cf2-8fef-34f90f910ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:12.991102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffaebc-4c70-4cf2-8fef-34f90f910ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:12.991821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffaebc-4c70-4cf2-8fef-34f90f910ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:12.994141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffaebc-4c70-4cf2-8fef-34f90f910ca8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:13.003730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1198/2410] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:13.007823 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:13.017983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c461-b562-4f5c-bd4a-ca22386ef0b5 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:13.022525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:13.023395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:13.023783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:13.024066 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] PATH_INFO: `/v3/projects/20f878c5ccd2471bb9bec88d797f3e06/users/7bd2b4340d964c7c93b60ad0d66ee74c/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:13.026030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f878c5ccd2471bb9bec88d797f3e06, user_id=7bd2b4340d964c7c93b60ad0d66ee74c, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:13.028632 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:13.038479 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1213/2411] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:13 2022] PUT /identity/v3/projects/20f878c5ccd2471bb9bec88d797f3e06/users/7bd2b4340d964c7c93b60ad0d66ee74c/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:13.049780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ed2c-8a54-4821-a219-b20a144d3ab9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:13.050082 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ed2c-8a54-4821-a219-b20a144d3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:13.050352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ed2c-8a54-4821-a219-b20a144d3ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:13.075889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3e54ed2c-8a54-4821-a219-b20a144d3ab9 None None] MFA Rules not processed for user `7bd2b4340d964c7c93b60ad0d66ee74c`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:13.076981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3e54ed2c-8a54-4821-a219-b20a144d3ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:13.140175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1199/2412] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:13.150946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:13.152629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:13.207051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ead4fa-73b5-4a20-adb1-a5f2a3691ee2 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:13.210603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b14f6-2374-4579-a711-a0a5be6f3891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:13.211248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b14f6-2374-4579-a711-a0a5be6f3891 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:13.211524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b14f6-2374-4579-a711-a0a5be6f3891 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:13.211791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b14f6-2374-4579-a711-a0a5be6f3891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:13.220281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b14f6-2374-4579-a711-a0a5be6f3891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:13.221712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b14f6-2374-4579-a711-a0a5be6f3891 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:13.231104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1214/2413] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:13.567769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54ed2c-8a54-4821-a219-b20a144d3ab9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:13.626968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54ed2c-8a54-4821-a219-b20a144d3ab9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:13.631517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:13.632417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:13.632695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:13.633530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] PATH_INFO: `/v3/users/d704e2455ad24c2fa2340e7fdc49dcc1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:13.634712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d704e2455ad24c2fa2340e7fdc49dcc1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:13.636609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:13.679307 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd704e2455ad24c2fa2340e7fdc49dcc1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:13.685814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd704e2455ad24c2fa2340e7fdc49dcc1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:13.686420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd704e2455ad24c2fa2340e7fdc49dcc1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:13.687019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd704e2455ad24c2fa2340e7fdc49dcc1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:13.693623 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd704e2455ad24c2fa2340e7fdc49dcc1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:13.710926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1200/2414] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:13 2022] DELETE /identity/v3/users/d704e2455ad24c2fa2340e7fdc49dcc1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:13.716382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:13.716862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:13.716970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:13.734378 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:13.735552 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:13.792086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1215/2415] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:13.802158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:13.803578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:13.857954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73187553-8261-43f8-b2fd-d493e571da4d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:13.861544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:13.862123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:13.862425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:13.862692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:13.871542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:13.872946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:13.882049 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1201/2416] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:14.137073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:14.138803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:14.151022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4d7ef-7949-44a2-9473-b0aa094e440d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:14.155574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:14.156428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:14.156706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:14.156980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] PATH_INFO: `/v3/projects/eb7119b4f1e0424ca770b32006d082c5` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:14.158173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7119b4f1e0424ca770b32006d082c5)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:14.160056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:14.204909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7119b4f1e0424ca770b32006d082c5', 'request_id': 'req-3aedd0e8-4330-4579-bccd-836bf9cbd30b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.211760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7119b4f1e0424ca770b32006d082c5', 'request_id': 'req-3aedd0e8-4330-4579-bccd-836bf9cbd30b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.217143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7119b4f1e0424ca770b32006d082c5', 'request_id': 'req-3aedd0e8-4330-4579-bccd-836bf9cbd30b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.227731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] The token cache is being invalidate because project eb7119b4f1e0424ca770b32006d082c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:14.228008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.228633 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.230160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1216/2417] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:14 2022] DELETE /identity/v3/projects/eb7119b4f1e0424ca770b32006d082c5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:14.234089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:14.243887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d342a3-3338-433e-951d-51c41172e6f1 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:14.297902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:14.298764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:14.299043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:14.299318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] PATH_INFO: `/v3/users/7bd2b4340d964c7c93b60ad0d66ee74c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:14.300530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd2b4340d964c7c93b60ad0d66ee74c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:14.302487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:14.346979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd2b4340d964c7c93b60ad0d66ee74c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.354220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd2b4340d964c7c93b60ad0d66ee74c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.354814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd2b4340d964c7c93b60ad0d66ee74c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.355442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd2b4340d964c7c93b60ad0d66ee74c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.362026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f17fe866-2e8e-4267-9d65-bbc7de7ddc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd2b4340d964c7c93b60ad0d66ee74c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.378523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1202/2418] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:14 2022] DELETE /identity/v3/users/7bd2b4340d964c7c93b60ad0d66ee74c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:14.638319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:14.640104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:14.654917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd0e8-4330-4579-bccd-836bf9cbd30b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:14.715293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:14.716143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:14.716420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:14.716977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] PATH_INFO: `/v3/projects/20f878c5ccd2471bb9bec88d797f3e06` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:14.717858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f878c5ccd2471bb9bec88d797f3e06)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:14.719737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:14.763269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f878c5ccd2471bb9bec88d797f3e06', 'request_id': 'req-c74b84e3-abb1-410c-a23a-c2c1839656a6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.770512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f878c5ccd2471bb9bec88d797f3e06', 'request_id': 'req-c74b84e3-abb1-410c-a23a-c2c1839656a6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.776277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f878c5ccd2471bb9bec88d797f3e06', 'request_id': 'req-c74b84e3-abb1-410c-a23a-c2c1839656a6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.786684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] The token cache is being invalidate because project 20f878c5ccd2471bb9bec88d797f3e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:14.786966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.787655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-c74b84e3-abb1-410c-a23a-c2c1839656a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:14.789173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1217/2419] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:14 2022] DELETE /identity/v3/projects/20f878c5ccd2471bb9bec88d797f3e06 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:14.794531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbf430-9083-4662-aeaa-322c18e0b35b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:14.795000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbf430-9083-4662-aeaa-322c18e0b35b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:14.795103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbf430-9083-4662-aeaa-322c18e0b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:14.814603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-30cbf430-9083-4662-aeaa-322c18e0b35b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:14.815918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-30cbf430-9083-4662-aeaa-322c18e0b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:14.873347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1203/2420] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:14.880950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a460-c106-4ab1-915d-bc88f5472a44 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:14.881234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a460-c106-4ab1-915d-bc88f5472a44 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:14.881557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a460-c106-4ab1-915d-bc88f5472a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:14.900285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-cfd8a460-c106-4ab1-915d-bc88f5472a44 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:14.901410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cfd8a460-c106-4ab1-915d-bc88f5472a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:14.909089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1218/2421] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:14.913051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbf430-9083-4662-aeaa-322c18e0b35b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:14.923044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbf430-9083-4662-aeaa-322c18e0b35b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:14.927503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:14.928156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:14.928426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:14.928696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:14.929401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:14.929737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:14.931311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:14.942205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1204/2422] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:14.946400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8a460-c106-4ab1-915d-bc88f5472a44 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:14.955222 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8a460-c106-4ab1-915d-bc88f5472a44 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:14.959765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:14.960403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:14.960678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:14.960947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:14.961646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:14.964037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:14.996008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1219/2423] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:14 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:15.000318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.010389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70892a91-9973-4314-b495-acfa3c8f2a86 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.064088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.064756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.065032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.065299 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.065992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.067875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.090420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1205/2424] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:14 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:15.091693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.102105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5fde-e6be-4f03-892c-f852df1320a8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.107716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.108370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.108652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.108927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.109677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.111254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.121386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1220/2425] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:15.125290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.135457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea16055-8859-4bdf-9409-f9e335519eea admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.139949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d299a-98cd-4dc3-ba0f-ed45028f7153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.140585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d299a-98cd-4dc3-ba0f-ed45028f7153 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.140859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d299a-98cd-4dc3-ba0f-ed45028f7153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.141393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d299a-98cd-4dc3-ba0f-ed45028f7153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.142128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d299a-98cd-4dc3-ba0f-ed45028f7153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.143691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d299a-98cd-4dc3-ba0f-ed45028f7153 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.153902 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1206/2426] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:15.157581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.167155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f948a-4e48-43f7-a2a8-34b49663d74c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.171642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.172500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.172790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.173042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] PATH_INFO: `/v3/projects/f92d0d2150dc43b5b84f80408830faf6/users/b538342c75704d4d86d25ea507045391/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.187059 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92d0d2150dc43b5b84f80408830faf6, user_id=b538342c75704d4d86d25ea507045391, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.189699 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.204165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1221/2427] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:15 2022] PUT /identity/v3/projects/f92d0d2150dc43b5b84f80408830faf6/users/b538342c75704d4d86d25ea507045391/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:15.214863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efeaf-80a9-41ab-adad-017b7469c8e5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.215156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efeaf-80a9-41ab-adad-017b7469c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.215436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efeaf-80a9-41ab-adad-017b7469c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.241342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0d6efeaf-80a9-41ab-adad-017b7469c8e5 None None] MFA Rules not processed for user `b538342c75704d4d86d25ea507045391`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:15.242576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0d6efeaf-80a9-41ab-adad-017b7469c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:15.303401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1207/2428] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:15.307783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.367813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5d9d4-b07e-4ee2-9c8a-b59035689194 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.372388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.373029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.373305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.373605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.374268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.376144 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.401371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1222/2429] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:15 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:15.405789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6efeaf-80a9-41ab-adad-017b7469c8e5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.416343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6efeaf-80a9-41ab-adad-017b7469c8e5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.469227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.469913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.470194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.470468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.471180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.473083 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.491717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1208/2430] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:15 2022] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:15.496415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.506505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41690d-82e5-4aa0-84b7-f286bdb714fd admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.511596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.512240 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.512514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.512782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.513515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.515081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.525524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1223/2431] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:15.529541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.539070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1261-dbc4-4818-8292-565705bf0581 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.543685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.544547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.544823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.545092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] PATH_INFO: `/v3/projects/c5878996f7314e86bf51783519f7ae6d/users/d921b7687c1f476f85f31de95dbeee15/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.560004 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5878996f7314e86bf51783519f7ae6d, user_id=d921b7687c1f476f85f31de95dbeee15, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.562730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.575181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1209/2432] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:15 2022] PUT /identity/v3/projects/c5878996f7314e86bf51783519f7ae6d/users/d921b7687c1f476f85f31de95dbeee15/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:15.579052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.588618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d54a-6be1-40d3-991f-c01b610fa946 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.643002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735665e-2671-45d3-b576-21f6978a15c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.643657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735665e-2671-45d3-b576-21f6978a15c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.643948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735665e-2671-45d3-b576-21f6978a15c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.644192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735665e-2671-45d3-b576-21f6978a15c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.644902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735665e-2671-45d3-b576-21f6978a15c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.646526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735665e-2671-45d3-b576-21f6978a15c9 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.656457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1224/2433] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:15.660533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.670784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bce94-925c-40fb-b8e1-60060d6803d0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.675452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.676339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.676622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.676894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] PATH_INFO: `/v3/projects/c5878996f7314e86bf51783519f7ae6d/users/d921b7687c1f476f85f31de95dbeee15/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.678888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5878996f7314e86bf51783519f7ae6d, user_id=d921b7687c1f476f85f31de95dbeee15, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.682058 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.692295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1210/2434] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:15 2022] PUT /identity/v3/projects/c5878996f7314e86bf51783519f7ae6d/users/d921b7687c1f476f85f31de95dbeee15/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:15.703865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bf30-9e0b-4c23-97e3-27e29c0fbe4c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.704279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bf30-9e0b-4c23-97e3-27e29c0fbe4c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.704619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bf30-9e0b-4c23-97e3-27e29c0fbe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.730525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-36c1bf30-9e0b-4c23-97e3-27e29c0fbe4c None None] MFA Rules not processed for user `d921b7687c1f476f85f31de95dbeee15`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:15.731708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-36c1bf30-9e0b-4c23-97e3-27e29c0fbe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:15.801399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1225/2435] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:15.813785 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.815548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:15.871750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410283b-4185-40f6-97ec-2be2b7e1279d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.875321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.875950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.876225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.876490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:15.885109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:15.886538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:15.896433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1211/2436] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:15.975326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1bf30-9e0b-4c23-97e3-27e29c0fbe4c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:15.987621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1bf30-9e0b-4c23-97e3-27e29c0fbe4c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:15.991248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32ff8-4d1a-43e0-a0ec-66d343b56ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:15.991886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32ff8-4d1a-43e0-a0ec-66d343b56ebe service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:15.992166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32ff8-4d1a-43e0-a0ec-66d343b56ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:15.992503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32ff8-4d1a-43e0-a0ec-66d343b56ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:16.053337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32ff8-4d1a-43e0-a0ec-66d343b56ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:16.054806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32ff8-4d1a-43e0-a0ec-66d343b56ebe service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:16.064150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1226/2437] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:16.321725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:16.379959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700cf0b-e90e-4e44-bf77-0f40a7686866 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:16.384407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:16.385249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:16.385558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:16.385829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] PATH_INFO: `/v3/users/b538342c75704d4d86d25ea507045391` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:16.387008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] RBAC: Authorizing `identity:delete_user(user_id=b538342c75704d4d86d25ea507045391)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:16.388881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:16.432414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b538342c75704d4d86d25ea507045391'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:16.438679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b538342c75704d4d86d25ea507045391'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:16.439389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b538342c75704d4d86d25ea507045391'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:16.440064 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b538342c75704d4d86d25ea507045391'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:16.446768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b538342c75704d4d86d25ea507045391'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:16.463199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1212/2438] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:16 2022] DELETE /identity/v3/users/b538342c75704d4d86d25ea507045391 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:16.467783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:16.468068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:16.468472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:16.486289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:16.487469 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:16.543698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1227/2439] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:16.553112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:16.554485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:16.611453 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6513d8e-1230-4e42-b55d-2af5cd31bace admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:16.615079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:16.615715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:16.615996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:16.616267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:16.624977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:16.626433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:16.636592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1213/2440] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:16.889242 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:16.890720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:16.908203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2208e3-1b87-4906-8e8e-1a7a61b94c63 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:16.913232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:16.914168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:16.914448 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:16.915478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] PATH_INFO: `/v3/projects/f92d0d2150dc43b5b84f80408830faf6` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:16.916260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92d0d2150dc43b5b84f80408830faf6)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:16.918544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:16.973072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92d0d2150dc43b5b84f80408830faf6', 'request_id': 'req-595f2b77-5db3-4d0c-af48-e72599aefd19'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:16.982888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92d0d2150dc43b5b84f80408830faf6', 'request_id': 'req-595f2b77-5db3-4d0c-af48-e72599aefd19'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:16.988852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92d0d2150dc43b5b84f80408830faf6', 'request_id': 'req-595f2b77-5db3-4d0c-af48-e72599aefd19'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.000204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] The token cache is being invalidate because project f92d0d2150dc43b5b84f80408830faf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:17.000484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.001376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.002780 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1228/2441] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:16 2022] DELETE /identity/v3/projects/f92d0d2150dc43b5b84f80408830faf6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:17.006799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.017255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4f636-c30b-4f0d-aea5-7d666c74f260 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.088228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.089220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.089527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.089804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] PATH_INFO: `/v3/users/d921b7687c1f476f85f31de95dbeee15` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.091130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d921b7687c1f476f85f31de95dbeee15)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.093189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.146603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd921b7687c1f476f85f31de95dbeee15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.153745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd921b7687c1f476f85f31de95dbeee15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.154355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd921b7687c1f476f85f31de95dbeee15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.154953 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd921b7687c1f476f85f31de95dbeee15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.161750 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4772bf69-736d-4f63-915c-3f3e45bbbf55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd921b7687c1f476f85f31de95dbeee15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.178786 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1214/2442] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:17 2022] DELETE /identity/v3/users/d921b7687c1f476f85f31de95dbeee15 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:17.439314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.440708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:17.454102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f2b77-5db3-4d0c-af48-e72599aefd19 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.519219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.520107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.520439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.520655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] PATH_INFO: `/v3/projects/c5878996f7314e86bf51783519f7ae6d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.521876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5878996f7314e86bf51783519f7ae6d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.523770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.571804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5878996f7314e86bf51783519f7ae6d', 'request_id': 'req-2eb98eda-2b16-4a67-9a37-321db4677f12'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.578741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5878996f7314e86bf51783519f7ae6d', 'request_id': 'req-2eb98eda-2b16-4a67-9a37-321db4677f12'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.584464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5878996f7314e86bf51783519f7ae6d', 'request_id': 'req-2eb98eda-2b16-4a67-9a37-321db4677f12'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.595056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] The token cache is being invalidate because project c5878996f7314e86bf51783519f7ae6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:17.595364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.596594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2eb98eda-2b16-4a67-9a37-321db4677f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:17.598136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1229/2443] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:17 2022] DELETE /identity/v3/projects/c5878996f7314e86bf51783519f7ae6d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:17.603666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65446e-530f-490d-8756-1dc7eece9539 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.603952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65446e-530f-490d-8756-1dc7eece9539 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.604389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65446e-530f-490d-8756-1dc7eece9539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.622363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9a65446e-530f-490d-8756-1dc7eece9539 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:17.623547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9a65446e-530f-490d-8756-1dc7eece9539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:17.678970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1215/2444] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:17.687118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f62f-cdb8-4505-81d8-c38753dffdf5 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.687403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f62f-cdb8-4505-81d8-c38753dffdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.687678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f62f-cdb8-4505-81d8-c38753dffdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.705362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d6b3f62f-cdb8-4505-81d8-c38753dffdf5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:17.706574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d6b3f62f-cdb8-4505-81d8-c38753dffdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:17.714297 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1230/2445] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:17.718278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65446e-530f-490d-8756-1dc7eece9539 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.728022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65446e-530f-490d-8756-1dc7eece9539 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.732507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.733145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.733421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.733726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.734439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:17.734741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.736308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.747712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1216/2446] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:17.751693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f62f-cdb8-4505-81d8-c38753dffdf5 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.760541 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f62f-cdb8-4505-81d8-c38753dffdf5 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.765038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.765698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.765974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.766509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.767155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.769017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.794640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1231/2447] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:17 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:17.798735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.808421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340a5c-6883-400d-8e3e-acd236652600 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.862025 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.862686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.862966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.863257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.863924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.865882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.884709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1217/2448] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:17 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:17.888772 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.898925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8e1a2-a5a1-42a2-ab08-173ffc38cbd3 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.903957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.904607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.904889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.905165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.905918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.907618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.918271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1232/2449] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:17.921957 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.931845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b987b03-b70c-4888-81c3-4230f65783b1 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.936297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef26b75-71d0-4143-b366-5b16afe7aa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.936936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef26b75-71d0-4143-b366-5b16afe7aa5e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.937215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef26b75-71d0-4143-b366-5b16afe7aa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.937515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef26b75-71d0-4143-b366-5b16afe7aa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.938218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef26b75-71d0-4143-b366-5b16afe7aa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.939784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef26b75-71d0-4143-b366-5b16afe7aa5e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.949812 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1218/2450] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:17.953651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:17.963293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684b7d2-4340-419b-91d7-f2df7ea43f6c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:17.967819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:17.968687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:17.968964 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:17.969236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] PATH_INFO: `/v3/projects/d906eb75d4b94d78bd9d9a37676e9302/users/05ce6c1d97804ab8a814984b8ab6ae09/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:17.984286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d906eb75d4b94d78bd9d9a37676e9302, user_id=05ce6c1d97804ab8a814984b8ab6ae09, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:17.986936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:17.999704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1233/2451] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:17 2022] PUT /identity/v3/projects/d906eb75d4b94d78bd9d9a37676e9302/users/05ce6c1d97804ab8a814984b8ab6ae09/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:18.004756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ada325-afad-438b-a591-e8af025f9922 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:18.005047 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ada325-afad-438b-a591-e8af025f9922 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:18.005325 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ada325-afad-438b-a591-e8af025f9922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:18.023390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-84ada325-afad-438b-a591-e8af025f9922 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:18.024574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-84ada325-afad-438b-a591-e8af025f9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:18.080603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1219/2452] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:18.090007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:18.091692 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:18.148139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068dc3d-4979-45aa-8bf0-b6d12e36a18b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:18.151751 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:18.152460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:18.152744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:18.153015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:18.162010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:18.163417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:18.173030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1234/2453] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:18.779960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35187772-662c-4603-a75d-9c656f743f45 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:18.780249 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35187772-662c-4603-a75d-9c656f743f45 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:18.780529 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35187772-662c-4603-a75d-9c656f743f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:18.806914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-35187772-662c-4603-a75d-9c656f743f45 None None] MFA Rules not processed for user `05ce6c1d97804ab8a814984b8ab6ae09`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:18.808130 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-35187772-662c-4603-a75d-9c656f743f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:18.870959 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1220/2454] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:18.876759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:18.886657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8f1d-8e13-4624-b3c7-11568dae1f3b service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:18.891662 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:18.892308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:18.892585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:18.892863 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:18.893579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:18.895477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:18.921252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1235/2455] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:18 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:18.925045 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35187772-662c-4603-a75d-9c656f743f45 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:18.935454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35187772-662c-4603-a75d-9c656f743f45 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:18.991391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:18.992061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:18.992339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:18.992608 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:18.993290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:18.995223 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:19.015233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1221/2456] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:18 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:19.019427 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:19.030091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d43425-277e-4202-98cd-15ae6f3c9d35 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:19.034583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:19.035226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:19.035507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:19.035782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:19.036534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:19.038165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:19.048235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1236/2457] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:19.052075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:19.062093 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c420-171f-4226-8046-12033590bab1 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:19.066771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:19.067648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:19.067930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:19.068202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] PATH_INFO: `/v3/projects/7282138e66be4bdbb947b5e0e476f317/users/991454488d194ca6adc8c057c3e2f649/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:19.083050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282138e66be4bdbb947b5e0e476f317, user_id=991454488d194ca6adc8c057c3e2f649, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:19.085811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:19.098738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1222/2458] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:19 2022] PUT /identity/v3/projects/7282138e66be4bdbb947b5e0e476f317/users/991454488d194ca6adc8c057c3e2f649/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:19.102654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:19.112939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536445c-f700-428c-99f8-3b913e8d3a76 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:19.168594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa457d37-c31b-4c58-ab55-967678e1cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:19.169286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa457d37-c31b-4c58-ab55-967678e1cb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:19.169602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa457d37-c31b-4c58-ab55-967678e1cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:19.169877 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa457d37-c31b-4c58-ab55-967678e1cb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:19.170591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa457d37-c31b-4c58-ab55-967678e1cb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:19.172198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa457d37-c31b-4c58-ab55-967678e1cb49 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:19.181922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1237/2459] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:19.185874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:19.195800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531aa66-7181-49d2-8047-f66e1b3a4325 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:19.200860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:19.201769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:19.202050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:19.202353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] PATH_INFO: `/v3/projects/7282138e66be4bdbb947b5e0e476f317/users/991454488d194ca6adc8c057c3e2f649/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:19.204334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282138e66be4bdbb947b5e0e476f317, user_id=991454488d194ca6adc8c057c3e2f649, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:19.206999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:19.217408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1223/2460] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:19 2022] PUT /identity/v3/projects/7282138e66be4bdbb947b5e0e476f317/users/991454488d194ca6adc8c057c3e2f649/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:19.811485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:19.811824 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:19.812145 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:19.842776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] MFA Rules not processed for user `991454488d194ca6adc8c057c3e2f649`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:19.847912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:19.912905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1238/2461] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:19.925145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:19.927000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:19.986010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50156f7e-2489-48bd-affb-ba1ae8387cfb admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:19.989686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:19.990326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:19.990648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:19.990923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:20.046187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:20.047619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:20.056728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1224/2462] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:21.399836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:21.401960 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:21.414424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651725c-a83a-4bc1-a0e2-60f42f89a9b3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:21.418847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df08305-1efb-4e88-b676-541d13a0bd7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:21.419455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08305-1efb-4e88-b676-541d13a0bd7c service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:21.419729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08305-1efb-4e88-b676-541d13a0bd7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:21.420002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08305-1efb-4e88-b676-541d13a0bd7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:21.429025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df08305-1efb-4e88-b676-541d13a0bd7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:21.430462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df08305-1efb-4e88-b676-541d13a0bd7c service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:21.440623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1239/2463] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:30.618357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:30.620112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:30.707629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42594b73-7be0-4efc-b5aa-9ff5c0f8a63f service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:30.714601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:30.715988 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:30.716432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:30.716858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] PATH_INFO: `/v3/users/f928dd9ea0f347578660fdb0e4ad93f6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:30.718306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f928dd9ea0f347578660fdb0e4ad93f6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:30.721405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:30.789936 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f928dd9ea0f347578660fdb0e4ad93f6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:30.802603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f928dd9ea0f347578660fdb0e4ad93f6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:30.803295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f928dd9ea0f347578660fdb0e4ad93f6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:30.804280 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f928dd9ea0f347578660fdb0e4ad93f6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:30.812469 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f928dd9ea0f347578660fdb0e4ad93f6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:30.841574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1225/2464] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:30 2022] DELETE /identity/v3/users/f928dd9ea0f347578660fdb0e4ad93f6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:30.843114 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:30.843584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:30.843665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:30.862251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:30.863689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:30.926604 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1240/2465] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:30.937182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:30.938148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:31.015303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d9126-04bd-4dcd-95af-956d4b02eddc admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:31.019545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:31.020206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:31.020483 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:31.020875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:31.033159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:31.036484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:31.047927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1226/2466] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:31.483211 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:31.484909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:31.499234 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5772b-7750-4556-9a82-d8e1ca4eec73 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:31.503958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:31.504828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:31.505091 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:31.505571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] PATH_INFO: `/v3/projects/85b08b06631a4d8e8c9dd284dda8d86a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:31.506743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b08b06631a4d8e8c9dd284dda8d86a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:31.508696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:31.568200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b08b06631a4d8e8c9dd284dda8d86a', 'request_id': 'req-2c91f780-dd94-4ce4-8d20-9db62806d6e8'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.575428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b08b06631a4d8e8c9dd284dda8d86a', 'request_id': 'req-2c91f780-dd94-4ce4-8d20-9db62806d6e8'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.581004 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b08b06631a4d8e8c9dd284dda8d86a', 'request_id': 'req-2c91f780-dd94-4ce4-8d20-9db62806d6e8'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.592259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] The token cache is being invalidate because project 85b08b06631a4d8e8c9dd284dda8d86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:31.592540 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.593165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.594955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1241/2467] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:31 2022] DELETE /identity/v3/projects/85b08b06631a4d8e8c9dd284dda8d86a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:31.598968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:31.608769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960b7c3-dbd4-4c8e-8ace-d5881e8cd224 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:31.664566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:31.665484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:31.665757 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:31.666572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] PATH_INFO: `/v3/users/9d3b15c1f05645a7a941eca823c52bc0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:31.667818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3b15c1f05645a7a941eca823c52bc0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:31.669969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:31.731695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3b15c1f05645a7a941eca823c52bc0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.739111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3b15c1f05645a7a941eca823c52bc0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.739788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3b15c1f05645a7a941eca823c52bc0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.740430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3b15c1f05645a7a941eca823c52bc0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.747209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0dbb9f75-aa90-4310-ab63-25d60e4f89dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3b15c1f05645a7a941eca823c52bc0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:31.764748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1227/2468] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:31 2022] DELETE /identity/v3/users/9d3b15c1f05645a7a941eca823c52bc0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:32.059277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.061654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:32.075612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91f780-dd94-4ce4-8d20-9db62806d6e8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.130243 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.131089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.131365 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.131637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] PATH_INFO: `/v3/projects/86597bfbb98247cf8f484935b56c1603` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.132782 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86597bfbb98247cf8f484935b56c1603)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.135258 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.178508 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86597bfbb98247cf8f484935b56c1603', 'request_id': 'req-36000067-c496-46ae-b2a3-39ee456fef11'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:32.184947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86597bfbb98247cf8f484935b56c1603', 'request_id': 'req-36000067-c496-46ae-b2a3-39ee456fef11'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:32.190146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86597bfbb98247cf8f484935b56c1603', 'request_id': 'req-36000067-c496-46ae-b2a3-39ee456fef11'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:32.200915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] The token cache is being invalidate because project 86597bfbb98247cf8f484935b56c1603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:32.201193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:32.201833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36000067-c496-46ae-b2a3-39ee456fef11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:32.203326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1242/2469] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:32 2022] DELETE /identity/v3/projects/86597bfbb98247cf8f484935b56c1603 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:32.208261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fb5b-af5f-470c-8db8-ac7e82e93a57 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.208576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fb5b-af5f-470c-8db8-ac7e82e93a57 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.208879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fb5b-af5f-470c-8db8-ac7e82e93a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.226693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7625fb5b-af5f-470c-8db8-ac7e82e93a57 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:32.227884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7625fb5b-af5f-470c-8db8-ac7e82e93a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:32.287938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1228/2470] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:32.296876 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5612331-973b-49bf-985a-b99595a2e7cc None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.297230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5612331-973b-49bf-985a-b99595a2e7cc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.297661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5612331-973b-49bf-985a-b99595a2e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.318966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b5612331-973b-49bf-985a-b99595a2e7cc None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:32.320288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b5612331-973b-49bf-985a-b99595a2e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:32.329487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1243/2471] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:32.333922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625fb5b-af5f-470c-8db8-ac7e82e93a57 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.344418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625fb5b-af5f-470c-8db8-ac7e82e93a57 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.349235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.349838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.350115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.350382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.351269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:32.351390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.353158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.368044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1229/2472] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:32.369672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5612331-973b-49bf-985a-b99595a2e7cc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.378559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5612331-973b-49bf-985a-b99595a2e7cc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.388441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.389092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.389393 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.389694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.390476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.392748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.420196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1244/2473] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:32 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:32.425097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.436308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe4bb-e8ba-401f-a1e6-c859717ea5eb admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.499779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.500467 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.500753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.501278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.512342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.512342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.528597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1230/2474] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:32 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:32.532564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.543952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1e13-3cb2-41cf-b520-9ee15ed498d8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.548873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.549576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.549859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.550133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.550894 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.552519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.564272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1245/2475] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:32.568336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.579783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801791-bdf2-4064-b3da-18f8da93bc34 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.584778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c2e2-67f2-4e12-b66f-a5aba70c08fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.585491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c2e2-67f2-4e12-b66f-a5aba70c08fe admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.585781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c2e2-67f2-4e12-b66f-a5aba70c08fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.586163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c2e2-67f2-4e12-b66f-a5aba70c08fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.586746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c2e2-67f2-4e12-b66f-a5aba70c08fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.588845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c2e2-67f2-4e12-b66f-a5aba70c08fe admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.599392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1231/2476] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:32.604917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.616013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf75d-0aa2-4f91-b0b7-9fb7e8f22fab admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.622073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.622952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.623231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.623565 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] PATH_INFO: `/v3/projects/15ac31e980bb4a6f9f15088888690934/users/eac8c442fbc64f13b9097373c7e9661b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.643007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ac31e980bb4a6f9f15088888690934, user_id=eac8c442fbc64f13b9097373c7e9661b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.645725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.658893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1246/2477] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:32 2022] PUT /identity/v3/projects/15ac31e980bb4a6f9f15088888690934/users/eac8c442fbc64f13b9097373c7e9661b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:32.670670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9878b-6feb-424c-b69c-cea1cc3e39dc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.671127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9878b-6feb-424c-b69c-cea1cc3e39dc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.671208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9878b-6feb-424c-b69c-cea1cc3e39dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.696836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b0f9878b-6feb-424c-b69c-cea1cc3e39dc None None] MFA Rules not processed for user `eac8c442fbc64f13b9097373c7e9661b`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:32.698282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b0f9878b-6feb-424c-b69c-cea1cc3e39dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:32.761360 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1232/2478] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:32.766255 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.825672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245c138-8366-4e63-871e-c445331590e2 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.830741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.831399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.831681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.831955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.832623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.834564 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.859363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1247/2479] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:32 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:32.863636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9878b-6feb-424c-b69c-cea1cc3e39dc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.874284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9878b-6feb-424c-b69c-cea1cc3e39dc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.931205 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.931870 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.932258 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.932573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.933369 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.935726 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.955544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1233/2480] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:32 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:32.960063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:32.972163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99202df-d521-4b18-8e5d-0beec45bbc59 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:32.978149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:32.978806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:32.979089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:32.979364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:32.980088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:32.981730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:32.993447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1248/2481] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:32.997567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.007333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4824-e266-484a-b718-5213275b2498 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.012520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc680b5-803b-4adb-9e3c-800b110e1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.013178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc680b5-803b-4adb-9e3c-800b110e1b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.013455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc680b5-803b-4adb-9e3c-800b110e1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.013756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc680b5-803b-4adb-9e3c-800b110e1b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.014490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc680b5-803b-4adb-9e3c-800b110e1b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.016365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc680b5-803b-4adb-9e3c-800b110e1b18 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.027026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1234/2482] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:33.031304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.041579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d1d6-cc45-4147-ac82-24c497fbafa3 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.046257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.046998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.047276 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.047548 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] PATH_INFO: `/v3/projects/270e4433c6c543ceac67f8bc4d29dd9c/users/8b358ae42b344efd9d77cff69a7c600f/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.065531 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270e4433c6c543ceac67f8bc4d29dd9c, user_id=8b358ae42b344efd9d77cff69a7c600f, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.068319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.082039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1249/2483] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:33 2022] PUT /identity/v3/projects/270e4433c6c543ceac67f8bc4d29dd9c/users/8b358ae42b344efd9d77cff69a7c600f/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:33.093067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6505fb-bdfd-4c1b-bdd1-1bbf27c3ef2d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.093351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6505fb-bdfd-4c1b-bdd1-1bbf27c3ef2d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.093661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6505fb-bdfd-4c1b-bdd1-1bbf27c3ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.120216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2e6505fb-bdfd-4c1b-bdd1-1bbf27c3ef2d None None] MFA Rules not processed for user `8b358ae42b344efd9d77cff69a7c600f`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:33.121421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2e6505fb-bdfd-4c1b-bdd1-1bbf27c3ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:33.190131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1235/2484] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:33.194498 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.256905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f530f1-c8f6-4f14-964c-4be154712429 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.262009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.262652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.262928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.263195 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.263861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.265769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.291005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1250/2485] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:33 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:33.295119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6505fb-bdfd-4c1b-bdd1-1bbf27c3ef2d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.305326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6505fb-bdfd-4c1b-bdd1-1bbf27c3ef2d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.358731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.359315 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.359592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.359863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.360553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.362511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.381857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1236/2486] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:33 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:33.386370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.398075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cb4b7-0c13-459a-85fe-bc183c2356ec admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.403387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.404040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.404320 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.404592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.405306 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.406922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.418281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1251/2487] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:33.423482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.434048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db178-69fe-46bb-b5ab-a7b1fcf6ada5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.439344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.440275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.440578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.440847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] PATH_INFO: `/v3/projects/2cea5f50d4c34537bb99d54d8d7958ed/users/d9114f627b744a47bea5f5980a2ad2c8/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.456934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cea5f50d4c34537bb99d54d8d7958ed, user_id=d9114f627b744a47bea5f5980a2ad2c8, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.460003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.472728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1237/2488] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:33 2022] PUT /identity/v3/projects/2cea5f50d4c34537bb99d54d8d7958ed/users/d9114f627b744a47bea5f5980a2ad2c8/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:33.476929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.487121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e53d-1acf-4d86-aebd-3c2966d32318 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.543323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46f379-1d18-418c-b3e8-835667ad843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.543980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f379-1d18-418c-b3e8-835667ad843b admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.544261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f379-1d18-418c-b3e8-835667ad843b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.544560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f379-1d18-418c-b3e8-835667ad843b admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.545264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46f379-1d18-418c-b3e8-835667ad843b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.546884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46f379-1d18-418c-b3e8-835667ad843b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.556241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1252/2489] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:33.561077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.570859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de12e-8fb4-4be0-9a13-e713b5afc32a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.575330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.576189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.576458 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.576719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] PATH_INFO: `/v3/projects/2cea5f50d4c34537bb99d54d8d7958ed/users/d9114f627b744a47bea5f5980a2ad2c8/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.578859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cea5f50d4c34537bb99d54d8d7958ed, user_id=d9114f627b744a47bea5f5980a2ad2c8, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.581517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.591246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1238/2490] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:33 2022] PUT /identity/v3/projects/2cea5f50d4c34537bb99d54d8d7958ed/users/d9114f627b744a47bea5f5980a2ad2c8/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:33.601194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.601511 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.601792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.628366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] MFA Rules not processed for user `d9114f627b744a47bea5f5980a2ad2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:33.629556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:33.696882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1253/2491] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:33.707180 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:33.709432 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:33.774349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca5fd2-ba7c-406d-8dad-a3c62da893a6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:33.778069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:33.779099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:33.779099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:33.779308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:33.790456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:33.793660 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:33.804221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1239/2492] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:34.330341 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:34.331913 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:34.338311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:34.346986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61504d6-6c67-4ce5-a6ac-66da256c5136 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:34.350512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:34.351141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:34.351420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:34.351690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:34.389073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb76c8-1833-4854-ab99-d84b524c5cd1 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:34.392859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:34.393518 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:34.393798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:34.394068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:34.395833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:34.410536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:34.411982 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:34.422688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1240/2493] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:34.464753 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:34.466335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:34.476150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1254/2494] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:35.075076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:35.077038 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:35.089068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6098f3-199a-4543-b51e-4a3f8e29209e service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:35.092801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:35.093675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:35.094043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:35.094409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:35.096291 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:35.110107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:35.111609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:35.122122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1241/2495] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:38.689916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:38.700836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c063-c988-4de7-9206-38029e2ca2d6 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:38.704534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:38.705180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:38.705473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:38.705761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:38.769390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:38.770932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:38.792286 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1255/2496] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:38.856725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:38.859137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:38.882828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f998b5-7cb5-477c-b2a8-87b56f36608b service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:38.890135 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:38.891357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:38.891727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:38.892240 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] PATH_INFO: `/v3/users/047fb46d1a764838bd8f8a44609a2e6f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:38.893579 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=047fb46d1a764838bd8f8a44609a2e6f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:38.905033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:38.986824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047fb46d1a764838bd8f8a44609a2e6f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:38.997651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047fb46d1a764838bd8f8a44609a2e6f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:38.999559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047fb46d1a764838bd8f8a44609a2e6f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.000236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047fb46d1a764838bd8f8a44609a2e6f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.009929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047fb46d1a764838bd8f8a44609a2e6f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.039197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1242/2497] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:38 2022] DELETE /identity/v3/users/047fb46d1a764838bd8f8a44609a2e6f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:39.267438 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:39.294650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017bc18-a852-4c28-b887-600eb4f682fc service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:39.358888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:39.361999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:39.375192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:39.376296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:39.376577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:39.376846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] PATH_INFO: `/v3/projects/e7beef313fe3439db0866cfdb10fdbe2` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:39.378131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7beef313fe3439db0866cfdb10fdbe2)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:39.380348 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:39.452509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7beef313fe3439db0866cfdb10fdbe2', 'request_id': 'req-777d4c60-ff2a-432b-9323-ece16ddced0f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.464356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7beef313fe3439db0866cfdb10fdbe2', 'request_id': 'req-777d4c60-ff2a-432b-9323-ece16ddced0f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.468825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24736d49-589e-482a-8a44-2bb9d7569142 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:39.477886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7beef313fe3439db0866cfdb10fdbe2', 'request_id': 'req-777d4c60-ff2a-432b-9323-ece16ddced0f'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.498060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] The token cache is being invalidate because project e7beef313fe3439db0866cfdb10fdbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:39.498339 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.499000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.500704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1256/2498] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:39 2022] DELETE /identity/v3/projects/e7beef313fe3439db0866cfdb10fdbe2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:39.501572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:39.503073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:39.535333 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:39.536343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:39.536712 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:39.537393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] PATH_INFO: `/v3/users/98211cfafca84542a64f8b3f0b34303b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:39.538727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98211cfafca84542a64f8b3f0b34303b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:39.541563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:39.579723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d4c60-ff2a-432b-9323-ece16ddced0f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:39.584613 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:39.585600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:39.585945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:39.586280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] PATH_INFO: `/v3/users/05ce6c1d97804ab8a814984b8ab6ae09` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:39.587553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ce6c1d97804ab8a814984b8ab6ae09)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:39.589578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:39.592188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98211cfafca84542a64f8b3f0b34303b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.607790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98211cfafca84542a64f8b3f0b34303b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.608923 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98211cfafca84542a64f8b3f0b34303b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.610005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98211cfafca84542a64f8b3f0b34303b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.619382 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-30100b30-8f88-42ab-a5b1-0da94b2026b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98211cfafca84542a64f8b3f0b34303b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.637643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1243/2499] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:39 2022] DELETE /identity/v3/users/98211cfafca84542a64f8b3f0b34303b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:39.639056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:39.639342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:39.639628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:39.644847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ce6c1d97804ab8a814984b8ab6ae09'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.656890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ce6c1d97804ab8a814984b8ab6ae09'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.658323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ce6c1d97804ab8a814984b8ab6ae09'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.666987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ce6c1d97804ab8a814984b8ab6ae09'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.667735 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-99fdb4d0-f956-4c1d-9239-d2b4cafd6d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ce6c1d97804ab8a814984b8ab6ae09'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:39.668215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:39.670175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:39.698866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1257/2500] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:39 2022] DELETE /identity/v3/users/05ce6c1d97804ab8a814984b8ab6ae09 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:39.762794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1244/2501] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:39.764691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:39.765047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:39.765330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:39.786462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:39.787769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:39.851516 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:39.853027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:39.874400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a1f47-411e-4c82-adce-8c8192390a6b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:39.908985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1258/2502] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:39.915494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:39.920267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:39.945014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722143e-4cd7-4f8c-945c-7e8fce321d80 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:39.949917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:39.951827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:39.952492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:39.952689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:39.952975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:39.953502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] PATH_INFO: `/v3/projects/d906eb75d4b94d78bd9d9a37676e9302` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:39.953670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:39.954098 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] PATH_INFO: `/v3/projects/ef1ba9318cf84308a3ff6ce6da85755d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:39.955057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d906eb75d4b94d78bd9d9a37676e9302)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:39.955630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1ba9318cf84308a3ff6ce6da85755d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:39.957686 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:39.957838 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.020608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd906eb75d4b94d78bd9d9a37676e9302', 'request_id': 'req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.022420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1ba9318cf84308a3ff6ce6da85755d', 'request_id': 'req-e43133e0-2f83-46c7-99bd-d21c8a89124a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.030004 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1ba9318cf84308a3ff6ce6da85755d', 'request_id': 'req-e43133e0-2f83-46c7-99bd-d21c8a89124a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.033486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd906eb75d4b94d78bd9d9a37676e9302', 'request_id': 'req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.039677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd906eb75d4b94d78bd9d9a37676e9302', 'request_id': 'req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.039821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1ba9318cf84308a3ff6ce6da85755d', 'request_id': 'req-e43133e0-2f83-46c7-99bd-d21c8a89124a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.052089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] The token cache is being invalidate because project ef1ba9318cf84308a3ff6ce6da85755d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:40.052449 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.052996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] The token cache is being invalidate because project d906eb75d4b94d78bd9d9a37676e9302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:40.053235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e43133e0-2f83-46c7-99bd-d21c8a89124a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.053414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.054157 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.056298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1259/2504] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:39 2022] DELETE /identity/v3/projects/d906eb75d4b94d78bd9d9a37676e9302 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:40.057152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.058961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.060774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1245/2504] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:39 2022] DELETE /identity/v3/projects/ef1ba9318cf84308a3ff6ce6da85755d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:40.062427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.062734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.063008 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.086481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:40.088440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.124404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2cc9-30e4-41a6-ba2d-678b5b22c8a1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.151475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1246/2505] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:40.154356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.159234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.173293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084b5d4-358b-401f-b34b-0720780ffc0e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.180179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.181612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.181881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.182155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] PATH_INFO: `/v3/users/991454488d194ca6adc8c057c3e2f649` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.183442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991454488d194ca6adc8c057c3e2f649)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.185342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.197017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a3264-0096-4227-8314-58d0cc5655ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.197017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3264-0096-4227-8314-58d0cc5655ed admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.197017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3264-0096-4227-8314-58d0cc5655ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.197765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3264-0096-4227-8314-58d0cc5655ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.199184 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3264-0096-4227-8314-58d0cc5655ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:40.200031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3264-0096-4227-8314-58d0cc5655ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.205740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3264-0096-4227-8314-58d0cc5655ed admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.218097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1260/2506] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:40.219567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba735-a58c-4cf3-96de-1b368a1eeb9a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.219852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba735-a58c-4cf3-96de-1b368a1eeb9a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.220127 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba735-a58c-4cf3-96de-1b368a1eeb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.238707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c61ba735-a58c-4cf3-96de-1b368a1eeb9a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:40.239911 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c61ba735-a58c-4cf3-96de-1b368a1eeb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.242524 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991454488d194ca6adc8c057c3e2f649'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.248028 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1261/2507] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:40.248936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ba735-a58c-4cf3-96de-1b368a1eeb9a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.251741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991454488d194ca6adc8c057c3e2f649'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.252406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991454488d194ca6adc8c057c3e2f649'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.253037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991454488d194ca6adc8c057c3e2f649'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.258273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ba735-a58c-4cf3-96de-1b368a1eeb9a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.260937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991454488d194ca6adc8c057c3e2f649'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.263290 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.263927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.264204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.264475 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.265155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.267335 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.278051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1247/2508] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:40 2022] DELETE /identity/v3/users/991454488d194ca6adc8c057c3e2f649 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:40.278842 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.280137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.298603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1262/2509] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:40.304030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.306878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.353275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac1e4-e07c-463e-afa2-c1488ba51ba8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.375802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27970a3f-cd98-4ea7-968e-51dc710f7585 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.380641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.381304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.381738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.382012 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.382838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.387174 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.409875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1263/2510] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:40.414081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.414823 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.415537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.416122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.416316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.417272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:40.417687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.419425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.429111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455523-4920-424f-af2e-7590782ef56b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.432376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1248/2511] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:40.434597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.435263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.435534 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.435800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.436708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.437556 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.438368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.450368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1264/2512] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:40.454569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.456026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270181-b8ed-47d7-9521-56bc2749abb4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.463985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.463985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.463985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.463985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.464409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.465401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.469893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fdd97-c485-41e1-af10-6519c5b0988c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.474934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.475933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.476279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.476607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.477436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.479200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.490930 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1265/2513] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:40.492352 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.494655 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.501871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1249/2514] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:40.502900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.508517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e846e-7ca9-4a82-b111-5f5c25424e84 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.578585 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440f08-c041-4d55-9a9c-ced101e46a6f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.584017 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.584766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.584907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.585164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.585600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] PATH_INFO: `/v3/projects/7282138e66be4bdbb947b5e0e476f317` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.586312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.586768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.586889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7282138e66be4bdbb947b5e0e476f317)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.587294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] PATH_INFO: `/v3/projects/deaeb49a9fe64d2e89224f2e15b27f66/users/dc0f20e812be47578681e0fe57fb006e/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.589241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.604952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deaeb49a9fe64d2e89224f2e15b27f66, user_id=dc0f20e812be47578681e0fe57fb006e, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.607799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.621839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1250/2515] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:40 2022] PUT /identity/v3/projects/deaeb49a9fe64d2e89224f2e15b27f66/users/dc0f20e812be47578681e0fe57fb006e/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:40.622440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.646005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7282138e66be4bdbb947b5e0e476f317', 'request_id': 'req-dd4dd264-b074-4a1d-a5b9-146456d6acd2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.652915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7282138e66be4bdbb947b5e0e476f317', 'request_id': 'req-dd4dd264-b074-4a1d-a5b9-146456d6acd2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.658376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7282138e66be4bdbb947b5e0e476f317', 'request_id': 'req-dd4dd264-b074-4a1d-a5b9-146456d6acd2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.671065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] The token cache is being invalidate because project 7282138e66be4bdbb947b5e0e476f317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:40.671342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.672087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dd4dd264-b074-4a1d-a5b9-146456d6acd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:40.673634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1266/2516] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:40 2022] DELETE /identity/v3/projects/7282138e66be4bdbb947b5e0e476f317 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:40.674986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.675264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.675532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.687238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e512fc-7dec-4003-bae5-2a2957640949 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.702014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] MFA Rules not processed for user `dc0f20e812be47578681e0fe57fb006e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:40.703203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.740919 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac710d-4deb-4ecb-9515-ff78e29d543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.741703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac710d-4deb-4ecb-9515-ff78e29d543f admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.742094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac710d-4deb-4ecb-9515-ff78e29d543f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.742413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac710d-4deb-4ecb-9515-ff78e29d543f admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.743162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac710d-4deb-4ecb-9515-ff78e29d543f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.745618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac710d-4deb-4ecb-9515-ff78e29d543f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.768527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1251/2517] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:40.772764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.773054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.773631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.773961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1267/2518] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:40.774998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.776416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.790162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318ec2-417c-4c70-9b77-7b2548523883 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.791499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:40.792691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.795134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d1899-a9b5-4955-a153-fbfd3e1173ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.795870 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1899-a9b5-4955-a153-fbfd3e1173ef admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.796219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1899-a9b5-4955-a153-fbfd3e1173ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.796557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1899-a9b5-4955-a153-fbfd3e1173ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.797272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d1899-a9b5-4955-a153-fbfd3e1173ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.798869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d1899-a9b5-4955-a153-fbfd3e1173ef admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.800806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1252/2519] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:40.801587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.802832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.810536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1268/2520] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:40.811846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a17ee-81f4-4cb3-8624-fbff43f2f964 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.812126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a17ee-81f4-4cb3-8624-fbff43f2f964 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.812435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a17ee-81f4-4cb3-8624-fbff43f2f964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.817670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b68db3-563c-479a-aafc-3c0617b201bf None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.828709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.830281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.830569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.830872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.831589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.833560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.841182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-078a17ee-81f4-4cb3-8624-fbff43f2f964 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:40.842843 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-078a17ee-81f4-4cb3-8624-fbff43f2f964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:40.853511 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1269/2521] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:40.854369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a17ee-81f4-4cb3-8624-fbff43f2f964 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.865689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1253/2522] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:40.866231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a17ee-81f4-4cb3-8624-fbff43f2f964 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.866495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.927764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.928340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.928624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.928902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.929784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.932294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.941186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ab0a-0b0a-4e83-9519-ec9c3c130ba8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.943553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1270/2523] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:40.944372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.953117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.954235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.954682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.955103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.955996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:40.956303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.956519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41032076-fd76-448b-a74c-b7171bcc6dc0 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.957940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.965423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.966235 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.966586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.966924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.967668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:40.969866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:40.973932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1254/2524] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:40.974977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:40.986681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeb0f4-ed27-4c68-9a8d-0d39aa7f44aa admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:40.993351 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:40.994804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:40.995259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:40.997681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1271/2525] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/users => generated 307 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:40.997860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] PATH_INFO: `/v3/projects/4b8d6ff5ff9f40c1a6fc8ad3b7858cf2/users/074dfa52a0344daeae2c5fea0e872fec/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:40.997975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.007414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530b862-37b9-4fa8-8b12-f2d8f6d4d545 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.012165 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65a8b9-731c-4eaf-a8b2-d1cb55c8712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.012530 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8d6ff5ff9f40c1a6fc8ad3b7858cf2, user_id=074dfa52a0344daeae2c5fea0e872fec, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.012808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a8b9-731c-4eaf-a8b2-d1cb55c8712a admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.013090 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a8b9-731c-4eaf-a8b2-d1cb55c8712a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.013364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a8b9-731c-4eaf-a8b2-d1cb55c8712a admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.014074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65a8b9-731c-4eaf-a8b2-d1cb55c8712a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.015657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.016197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65a8b9-731c-4eaf-a8b2-d1cb55c8712a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.031994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1255/2526] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:40 2022] PUT /identity/v3/projects/4b8d6ff5ff9f40c1a6fc8ad3b7858cf2/users/074dfa52a0344daeae2c5fea0e872fec/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:41.033222 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.049949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1272/2527] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:40 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:41.051515 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951443-94f3-457f-8748-86a09cf4a60a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.051962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951443-94f3-457f-8748-86a09cf4a60a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.052248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951443-94f3-457f-8748-86a09cf4a60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.079645 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-b2951443-94f3-457f-8748-86a09cf4a60a None None] MFA Rules not processed for user `074dfa52a0344daeae2c5fea0e872fec`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:41.080890 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b2951443-94f3-457f-8748-86a09cf4a60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.104027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10264c7-98c8-4ebe-a182-aaf7a677f434 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.153725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1273/2528] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:41.154439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951443-94f3-457f-8748-86a09cf4a60a None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.175921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.176738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.177492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.177633 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.178523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.180784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.191471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1256/2529] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:41.192435 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.203366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f7d8-d5e1-4302-ad67-6a4fe2e615ca admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.208210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.208856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.209141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.209413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.210195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.213359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.221301 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951443-94f3-457f-8748-86a09cf4a60a None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.226680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.227429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.227770 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.228067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.228757 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.230731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.254693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1257/2530] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:41 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:41.254693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.254693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.258771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1274/2531] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:41 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:41.258771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.270080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582369-10de-46b9-8114-c15c2d7d412c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.327043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7569bf-0e02-47a6-9934-4478c77781e0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.328292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.329271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.329643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.330010 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] PATH_INFO: `/v3/projects/2529e297992d47b0adf77f3a0d998172/users/967c9fd2c3d54bf0952c627eea0d7a17/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.332032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.333214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.333342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.333616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] PATH_INFO: `/v3/users/eac8c442fbc64f13b9097373c7e9661b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.334814 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac8c442fbc64f13b9097373c7e9661b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.336722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.348446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2529e297992d47b0adf77f3a0d998172, user_id=967c9fd2c3d54bf0952c627eea0d7a17, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.351199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.365806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1275/2532] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:41 2022] PUT /identity/v3/projects/2529e297992d47b0adf77f3a0d998172/users/967c9fd2c3d54bf0952c627eea0d7a17/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:41.366936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.392564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac8c442fbc64f13b9097373c7e9661b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:41.402115 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac8c442fbc64f13b9097373c7e9661b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:41.402873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac8c442fbc64f13b9097373c7e9661b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:41.403506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac8c442fbc64f13b9097373c7e9661b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:41.410415 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac8c442fbc64f13b9097373c7e9661b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:41.428503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1258/2533] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:41 2022] DELETE /identity/v3/users/eac8c442fbc64f13b9097373c7e9661b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:41.428893 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398a8e-fd2a-439f-adc5-773d9df30f0d admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.429621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.431255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.484695 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.485356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.485666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.485937 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.486607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.488517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.492986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d9dc-5ea2-4b1c-8667-6686ae0ab110 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.497705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d214c-beda-4792-85af-e98abaa12d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.498396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d214c-beda-4792-85af-e98abaa12d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.499932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d214c-beda-4792-85af-e98abaa12d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.500246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d214c-beda-4792-85af-e98abaa12d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.501015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d214c-beda-4792-85af-e98abaa12d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.502797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d214c-beda-4792-85af-e98abaa12d38 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.508164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1276/2534] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:41 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:41.508972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.510858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.515162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1259/2535] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:41.515162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a731c-32f2-465a-ad8b-c999f1fd2986 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.515162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a731c-32f2-465a-ad8b-c999f1fd2986 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.515162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a731c-32f2-465a-ad8b-c999f1fd2986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.522527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b424d-c2fd-483c-86ee-687d982c672c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.527653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.528305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.528585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.528861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.529603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.531200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.531847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-876a731c-32f2-465a-ad8b-c999f1fd2986 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:41.536604 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-876a731c-32f2-465a-ad8b-c999f1fd2986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.542781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1277/2537] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:41.546571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1260/2537] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:41.546694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.546890 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a731c-32f2-465a-ad8b-c999f1fd2986 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.549210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.562609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36bf52-db42-41e2-ae0a-8366ae75d268 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.563186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a731c-32f2-465a-ad8b-c999f1fd2986 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.567840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.568346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.568543 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.568824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.569007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.569103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.569288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.569595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.569836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.570316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.571920 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.572230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.583682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1261/2538] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:41.584491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.586287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1278/2539] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:41.590852 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.592494 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.595344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9336-8db4-4d01-8fd8-400e72400316 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.600003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.600872 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.601143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.601411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] PATH_INFO: `/v3/projects/2529e297992d47b0adf77f3a0d998172/users/967c9fd2c3d54bf0952c627eea0d7a17/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.604017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2529e297992d47b0adf77f3a0d998172, user_id=967c9fd2c3d54bf0952c627eea0d7a17, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.606695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.616627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1262/2540] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:41 2022] PUT /identity/v3/projects/2529e297992d47b0adf77f3a0d998172/users/967c9fd2c3d54bf0952c627eea0d7a17/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:41.617391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.657481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485107bb-5f56-4678-b6dc-7b6a398be63a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.680993 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78305e-83d8-4b19-a734-0edb8fcecf3d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.686141 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.687143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.687668 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.688039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] PATH_INFO: `/v3/projects/13837d1584fb48ed8bc8d623444af41d/users/5c1707bc7df54e32b70c222e2f637630/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.703663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13837d1584fb48ed8bc8d623444af41d, user_id=5c1707bc7df54e32b70c222e2f637630, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.706979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.707846 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a56c-f136-4f7d-86b7-97812a97defc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.708596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a56c-f136-4f7d-86b7-97812a97defc service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.708981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a56c-f136-4f7d-86b7-97812a97defc service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.709354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a56c-f136-4f7d-86b7-97812a97defc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.720514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458a56c-f136-4f7d-86b7-97812a97defc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.721821 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1263/2541] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:41 2022] PUT /identity/v3/projects/13837d1584fb48ed8bc8d623444af41d/users/5c1707bc7df54e32b70c222e2f637630/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:41.722773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.725708 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458a56c-f136-4f7d-86b7-97812a97defc service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.741557 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1279/2542] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:41.743588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417e58b-ba94-40c5-8b73-a673325f35b2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.743976 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417e58b-ba94-40c5-8b73-a673325f35b2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.744412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417e58b-ba94-40c5-8b73-a673325f35b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.797629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f417e58b-ba94-40c5-8b73-a673325f35b2 None None] MFA Rules not processed for user `967c9fd2c3d54bf0952c627eea0d7a17`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:41.798853 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f417e58b-ba94-40c5-8b73-a673325f35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.818025 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671acf8-bd1a-494b-a561-39bc9ee2d797 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:41.824593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233386a-0e11-402c-9976-bf3853181ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:41.825705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233386a-0e11-402c-9976-bf3853181ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.826019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233386a-0e11-402c-9976-bf3853181ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.826292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233386a-0e11-402c-9976-bf3853181ca8 admin admin] PATH_INFO: `/v3/projects/a9502b0e81e54e248c3aafa9162f9433/users/388837927afd490cb9b96b7ca600c16f/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.845294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233386a-0e11-402c-9976-bf3853181ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9502b0e81e54e248c3aafa9162f9433, user_id=388837927afd490cb9b96b7ca600c16f, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:41.848690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233386a-0e11-402c-9976-bf3853181ca8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:41.872534 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1264/2543] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:41 2022] PUT /identity/v3/projects/a9502b0e81e54e248c3aafa9162f9433/users/388837927afd490cb9b96b7ca600c16f/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:41.878564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:41.878846 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:41.879125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:41.918421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1280/2544] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:41.918634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] MFA Rules not processed for user `5c1707bc7df54e32b70c222e2f637630`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:41.918761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417e58b-ba94-40c5-8b73-a673325f35b2 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:41.918860 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:41.950803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417e58b-ba94-40c5-8b73-a673325f35b2 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.036026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.036799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.037152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.041296 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.041452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1265/2545] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:42.042040 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.042144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.042237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.042314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.051486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1281/2546] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:42.052551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.054420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.120948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad83c16-3841-4b1d-beb7-a4795a8074b1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.125228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.126263 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.126752 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.128009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.131925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d29636-c375-438d-8e68-896a62dc5687 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.137072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d380c-d936-4bb3-bab6-2f9e55cc437b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.137986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d380c-d936-4bb3-bab6-2f9e55cc437b service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.138156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d380c-d936-4bb3-bab6-2f9e55cc437b service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.138428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.139088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d380c-d936-4bb3-bab6-2f9e55cc437b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.140445 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.153786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1282/2547] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:42.155067 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.169431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8789e8-eed5-4f0d-9145-4675d6081fd6 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.179241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.181985 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.183205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.183859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] PATH_INFO: `/v3/projects/a9502b0e81e54e248c3aafa9162f9433/users/388837927afd490cb9b96b7ca600c16f/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.188513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9502b0e81e54e248c3aafa9162f9433, user_id=388837927afd490cb9b96b7ca600c16f, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.196268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.212736 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1283/2548] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:42 2022] PUT /identity/v3/projects/a9502b0e81e54e248c3aafa9162f9433/users/388837927afd490cb9b96b7ca600c16f/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:42.214661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.228467 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.230574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d380c-d936-4bb3-bab6-2f9e55cc437b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.232194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d380c-d936-4bb3-bab6-2f9e55cc437b service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.247445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1266/2549] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:42.251867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6a332-e3a3-4e27-af61-e0ca479ee103 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.252283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6a332-e3a3-4e27-af61-e0ca479ee103 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.253606 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6a332-e3a3-4e27-af61-e0ca479ee103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.305110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9db6a332-e3a3-4e27-af61-e0ca479ee103 None None] MFA Rules not processed for user `388837927afd490cb9b96b7ca600c16f`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:42.313273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9db6a332-e3a3-4e27-af61-e0ca479ee103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.356826 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42eee5-d32b-49b6-923b-c41d69de6df8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.362776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.365704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.366246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.367131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] PATH_INFO: `/v3/projects/15ac31e980bb4a6f9f15088888690934` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.369410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ac31e980bb4a6f9f15088888690934)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.372516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.416777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1267/2550] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:42.456013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6a332-e3a3-4e27-af61-e0ca479ee103 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.471605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ac31e980bb4a6f9f15088888690934', 'request_id': 'req-52f3f841-541b-4bbf-92e5-d9ab69c750be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.473671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6a332-e3a3-4e27-af61-e0ca479ee103 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.483053 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ac31e980bb4a6f9f15088888690934', 'request_id': 'req-52f3f841-541b-4bbf-92e5-d9ab69c750be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.489874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ac31e980bb4a6f9f15088888690934', 'request_id': 'req-52f3f841-541b-4bbf-92e5-d9ab69c750be'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.515275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] The token cache is being invalidate because project 15ac31e980bb4a6f9f15088888690934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:42.515572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.516497 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.520988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1284/2551] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:42 2022] DELETE /identity/v3/projects/15ac31e980bb4a6f9f15088888690934 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:42.520988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.524656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.574542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.576256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.577742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.578241 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] PATH_INFO: `/v3/users/dc0f20e812be47578681e0fe57fb006e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.579781 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0f20e812be47578681e0fe57fb006e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.582818 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.601539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f841-541b-4bbf-92e5-d9ab69c750be admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.606612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b697fc9-add2-46a9-be6d-cd742e7ccfef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.607458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697fc9-add2-46a9-be6d-cd742e7ccfef service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.608031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697fc9-add2-46a9-be6d-cd742e7ccfef service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.608784 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697fc9-add2-46a9-be6d-cd742e7ccfef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.611584 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9b697fc9-add2-46a9-be6d-cd742e7ccfef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.659776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0f20e812be47578681e0fe57fb006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.675710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0f20e812be47578681e0fe57fb006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.676639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0f20e812be47578681e0fe57fb006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.677544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0f20e812be47578681e0fe57fb006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.690482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0f20e812be47578681e0fe57fb006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.723454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1268/2552] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:42 2022] DELETE /identity/v3/users/dc0f20e812be47578681e0fe57fb006e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:42.727456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.730150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.756634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b697fc9-add2-46a9-be6d-cd742e7ccfef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.763118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b697fc9-add2-46a9-be6d-cd742e7ccfef service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.776730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1285/2553] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:42.778349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.778759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.779191 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.801325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:42.803739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.855163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148925-ef98-45b7-8a3e-ab5747a4069e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:42.870384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:42.871284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:42.871732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:42.872151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] PATH_INFO: `/v3/users/8b358ae42b344efd9d77cff69a7c600f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:42.873677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b358ae42b344efd9d77cff69a7c600f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:42.876009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:42.929505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1286/2554] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:42.944783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:42.946665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:42.959559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b358ae42b344efd9d77cff69a7c600f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.972855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b358ae42b344efd9d77cff69a7c600f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.973562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b358ae42b344efd9d77cff69a7c600f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.977572 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b358ae42b344efd9d77cff69a7c600f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:42.985897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b358ae42b344efd9d77cff69a7c600f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.016246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1269/2555] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:42 2022] DELETE /identity/v3/users/8b358ae42b344efd9d77cff69a7c600f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:43.017267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb74d7-3ec4-43f6-b957-8349093ab285 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:43.093710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:43.094414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:43.095089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:43.095406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:43.098997 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:43.200769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:43.202264 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:43.226486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1287/2556] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:43.449339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:43.451998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:43.477544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147454d-3e9c-4f20-8c5f-293099979eec admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:43.500677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:43.503059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:43.503903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:43.503903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] PATH_INFO: `/v3/projects/270e4433c6c543ceac67f8bc4d29dd9c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:43.505182 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270e4433c6c543ceac67f8bc4d29dd9c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:43.508639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:43.579475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270e4433c6c543ceac67f8bc4d29dd9c', 'request_id': 'req-19e0c2b0-7760-46b4-b459-27fe67011472'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.586550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270e4433c6c543ceac67f8bc4d29dd9c', 'request_id': 'req-19e0c2b0-7760-46b4-b459-27fe67011472'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.599175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270e4433c6c543ceac67f8bc4d29dd9c', 'request_id': 'req-19e0c2b0-7760-46b4-b459-27fe67011472'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.633768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] The token cache is being invalidate because project 270e4433c6c543ceac67f8bc4d29dd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:43.635064 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.638564 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.639326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:43.640811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:43.656086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9aa4-b8cc-4c22-b48f-01d1f7e75d9d service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:43.660151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1270/2557] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:43 2022] DELETE /identity/v3/projects/270e4433c6c543ceac67f8bc4d29dd9c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:43.664609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:43.679414 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:43.789776 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:43.790362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:43.790959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:43.791246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] PATH_INFO: `/v3/projects/deaeb49a9fe64d2e89224f2e15b27f66` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:43.792533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deaeb49a9fe64d2e89224f2e15b27f66)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:43.794573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:43.865952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0c2b0-7760-46b4-b459-27fe67011472 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:43.877144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:43.878748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:43.880202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:43.881202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] PATH_INFO: `/v3/users/d9114f627b744a47bea5f5980a2ad2c8` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:43.883411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9114f627b744a47bea5f5980a2ad2c8)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:43.886308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:43.890315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deaeb49a9fe64d2e89224f2e15b27f66', 'request_id': 'req-67509202-08eb-4f26-a41b-e7c0a9014d62'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.900340 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deaeb49a9fe64d2e89224f2e15b27f66', 'request_id': 'req-67509202-08eb-4f26-a41b-e7c0a9014d62'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.908975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deaeb49a9fe64d2e89224f2e15b27f66', 'request_id': 'req-67509202-08eb-4f26-a41b-e7c0a9014d62'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.925411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] The token cache is being invalidate because project deaeb49a9fe64d2e89224f2e15b27f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:43.925948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.926956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.928896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1288/2558] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:43 2022] DELETE /identity/v3/projects/deaeb49a9fe64d2e89224f2e15b27f66 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:43.934087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:43.936787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:43.981644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9114f627b744a47bea5f5980a2ad2c8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.992851 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9114f627b744a47bea5f5980a2ad2c8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.994341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9114f627b744a47bea5f5980a2ad2c8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:43.995522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9114f627b744a47bea5f5980a2ad2c8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.009796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9114f627b744a47bea5f5980a2ad2c8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.041235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1271/2559] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:43 2022] DELETE /identity/v3/users/d9114f627b744a47bea5f5980a2ad2c8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:44.073107 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67509202-08eb-4f26-a41b-e7c0a9014d62 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:44.144873 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:44.146022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:44.146470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:44.146933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] PATH_INFO: `/v3/users/967c9fd2c3d54bf0952c627eea0d7a17` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:44.148404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=967c9fd2c3d54bf0952c627eea0d7a17)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:44.151759 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:44.256799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967c9fd2c3d54bf0952c627eea0d7a17'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.273587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967c9fd2c3d54bf0952c627eea0d7a17'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.281669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967c9fd2c3d54bf0952c627eea0d7a17'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.295658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967c9fd2c3d54bf0952c627eea0d7a17'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.297889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967c9fd2c3d54bf0952c627eea0d7a17'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.326323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1289/2560] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:43 2022] DELETE /identity/v3/users/967c9fd2c3d54bf0952c627eea0d7a17 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:44.494999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:44.497308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:44.529968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f43485-722a-49f4-a65a-7156f5025060 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:44.644540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:44.645581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:44.646244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:44.646244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] PATH_INFO: `/v3/projects/2cea5f50d4c34537bb99d54d8d7958ed` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:44.647571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cea5f50d4c34537bb99d54d8d7958ed)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:44.649641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:44.700366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:44.701887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:44.717691 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306f1b1-c992-4f20-96b2-72d46ce7b92b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:44.760554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cea5f50d4c34537bb99d54d8d7958ed', 'request_id': 'req-6afef9e1-0ac9-4db5-970a-38a176e5d939'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.763924 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cea5f50d4c34537bb99d54d8d7958ed', 'request_id': 'req-6afef9e1-0ac9-4db5-970a-38a176e5d939'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.782006 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cea5f50d4c34537bb99d54d8d7958ed', 'request_id': 'req-6afef9e1-0ac9-4db5-970a-38a176e5d939'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.797537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] The token cache is being invalidate because project 2cea5f50d4c34537bb99d54d8d7958ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:44.798185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.799214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6afef9e1-0ac9-4db5-970a-38a176e5d939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.802444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1272/2561] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:44 2022] DELETE /identity/v3/projects/2cea5f50d4c34537bb99d54d8d7958ed => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:44.807412 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:44.808293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:44.808431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6bd05-15e3-4abf-850f-76cd4f5b40b9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:44.808586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:44.808695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6bd05-15e3-4abf-850f-76cd4f5b40b9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:44.808834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] PATH_INFO: `/v3/projects/2529e297992d47b0adf77f3a0d998172` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:44.808967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6bd05-15e3-4abf-850f-76cd4f5b40b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:44.810069 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2529e297992d47b0adf77f3a0d998172)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:44.811978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:44.833108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4dd6bd05-15e3-4abf-850f-76cd4f5b40b9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:44.835197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4dd6bd05-15e3-4abf-850f-76cd4f5b40b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:44.853735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1273/2562] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:44.862931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:44.863384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:44.863490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:44.896156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2529e297992d47b0adf77f3a0d998172', 'request_id': 'req-49f90241-1322-4502-b34c-814514cae32c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.902447 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:44.903761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:44.906239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2529e297992d47b0adf77f3a0d998172', 'request_id': 'req-49f90241-1322-4502-b34c-814514cae32c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.924143 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2529e297992d47b0adf77f3a0d998172', 'request_id': 'req-49f90241-1322-4502-b34c-814514cae32c'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.942914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] The token cache is being invalidate because project 2529e297992d47b0adf77f3a0d998172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:44.943212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.943905 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-49f90241-1322-4502-b34c-814514cae32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:44.945586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1290/2563] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:44 2022] DELETE /identity/v3/projects/2529e297992d47b0adf77f3a0d998172 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:44.951204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94422-5d56-4973-a895-e56d7f155a0a None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:44.951749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94422-5d56-4973-a895-e56d7f155a0a None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:44.952310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e94422-5d56-4973-a895-e56d7f155a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:44.986957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-c4e94422-5d56-4973-a895-e56d7f155a0a None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:44.988166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-c4e94422-5d56-4973-a895-e56d7f155a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:44.988464 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1274/2564] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:44.991859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:44.991859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:44.996960 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1291/2565] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:44.998201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:44.998485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:44.999271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.002703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51614a7-2445-4624-b26a-b3a5e6bb7cfb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.007514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.008372 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.008650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.008917 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] PATH_INFO: `/v3/users/074dfa52a0344daeae2c5fea0e872fec` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.010170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074dfa52a0344daeae2c5fea0e872fec)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.012063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.016196 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] MFA Rules not processed for user `3c8b295066bc4ae695f6e60b9b3dc5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:45.017385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.061132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074dfa52a0344daeae2c5fea0e872fec'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:45.069984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074dfa52a0344daeae2c5fea0e872fec'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:45.070971 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074dfa52a0344daeae2c5fea0e872fec'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:45.071871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074dfa52a0344daeae2c5fea0e872fec'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:45.076346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1292/2566] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:45.077198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.079470 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-410707c6-e756-41db-bb89-d5f59a9f5651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074dfa52a0344daeae2c5fea0e872fec'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:45.079679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.093743 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4584-0256-4151-9f41-6a2f10a9acc9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.098139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1275/2567] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:44 2022] DELETE /identity/v3/users/074dfa52a0344daeae2c5fea0e872fec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:45.098745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba708-d247-47cb-b259-7987050c1721 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.099033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba708-d247-47cb-b259-7987050c1721 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.099303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba708-d247-47cb-b259-7987050c1721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.100833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f342-a679-4c2e-b7c4-50432b845b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.101748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f342-a679-4c2e-b7c4-50432b845b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.102244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f342-a679-4c2e-b7c4-50432b845b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.102590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f342-a679-4c2e-b7c4-50432b845b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.103988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f342-a679-4c2e-b7c4-50432b845b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:45.104299 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f342-a679-4c2e-b7c4-50432b845b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.105928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f342-a679-4c2e-b7c4-50432b845b2c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.119700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-26eba708-d247-47cb-b259-7987050c1721 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:45.119987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1293/2568] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:45.120095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-26eba708-d247-47cb-b259-7987050c1721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.124392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62e050-01c4-4c97-aa9a-af1f87d7d514 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.124687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62e050-01c4-4c97-aa9a-af1f87d7d514 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.124971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62e050-01c4-4c97-aa9a-af1f87d7d514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.142369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9c62e050-01c4-4c97-aa9a-af1f87d7d514 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:45.143582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9c62e050-01c4-4c97-aa9a-af1f87d7d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.184448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1276/2569] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:45.185646 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eba708-d247-47cb-b259-7987050c1721 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.194649 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eba708-d247-47cb-b259-7987050c1721 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.199552 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.200203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.200490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.200765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.201445 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.203376 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.208940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1294/2570] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:45.209892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62e050-01c4-4c97-aa9a-af1f87d7d514 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.220202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62e050-01c4-4c97-aa9a-af1f87d7d514 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.224833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.225597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.225875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.226244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.227030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:45.227472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.229715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.240780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1277/2571] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:45.240780 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.241043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.248694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1295/2572] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:45.249706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.260640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76594664-a4e3-4fdd-946b-7bc5ae7382e6 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.317791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd281f-0e01-44b8-a615-9cff69bd47e6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.323695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.324358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.324904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.325184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.331172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.331919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.333272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.333670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.334410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.336466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.360761 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1296/2573] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:45.361678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.371495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdfc5f-2e0a-4d40-835a-e22087bcd079 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.376529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.377385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.377833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.378180 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.378933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.381000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.416972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1297/2574] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:45.416972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.429391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.431478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.442624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1278/2575] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:45.443656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.454073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7afef4-add3-4963-ae99-15f690ff1d8a service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.484746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b004ba7-53c7-45a4-a952-bf595919f74b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.489682 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.490355 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.490636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.490912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.492024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.493652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.505439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1298/2576] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:45.506742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.509862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.536910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.537778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.538071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.538430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.539321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.541561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.570330 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1279/2577] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:45.571297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.583174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f74b3-eb7c-4f60-8f94-9cb6c883d680 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.585611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f791864-bbe3-4812-b8de-b540c8e9cff9 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.593276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.593979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.594700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.594835 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.594960 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.595238 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.595587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.595959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.596323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.597573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.601416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.610532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1280/2578] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:45.610532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.620851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.622468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.632667 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1299/2579] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:45.633441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.640452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7d7bc-6f5f-4412-ad3a-6130d281f783 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.646203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.646383 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2796113-d33d-4086-89a1-e680e121d301 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.646873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.647152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.647425 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.648192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.650508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.652742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430f753-d506-44ea-bc00-fd46aa3f02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.653665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f753-d506-44ea-bc00-fd46aa3f02b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.653948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f753-d506-44ea-bc00-fd46aa3f02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.654223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f753-d506-44ea-bc00-fd46aa3f02b8 admin admin] PATH_INFO: `/v3/projects/36c610409cb149ba80a572998437aa0c/users/597a73a146564979b3db7c7154678fef/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.670640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1281/2580] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:45.673841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430f753-d506-44ea-bc00-fd46aa3f02b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c610409cb149ba80a572998437aa0c, user_id=597a73a146564979b3db7c7154678fef, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.674679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.678526 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430f753-d506-44ea-bc00-fd46aa3f02b8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.687841 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc5d3-1354-4285-b0c9-fcf7e872052f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.696110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1300/2581] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:45 2022] PUT /identity/v3/projects/36c610409cb149ba80a572998437aa0c/users/597a73a146564979b3db7c7154678fef/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:45.709124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.709492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.709860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.746838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] MFA Rules not processed for user `597a73a146564979b3db7c7154678fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:45.747358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.810250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.811101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.811713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.812179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.813446 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.815367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.830809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1282/2582] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:45.836236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1301/2583] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:45.836880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.845673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:45.846673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe7ec-5d16-4ac7-b06e-0c811d253864 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:45.847597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.853578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa7828-3ec4-42b9-9ed5-542517d2ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:45.854637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7828-3ec4-42b9-9ed5-542517d2ba2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.854918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7828-3ec4-42b9-9ed5-542517d2ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.855176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7828-3ec4-42b9-9ed5-542517d2ba2c admin admin] PATH_INFO: `/v3/projects/e8bc441ba91b42c5bf060261d1e5c3ba/users/a72892cd617b4d4ba4e91b8724a7c062/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.873751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa7828-3ec4-42b9-9ed5-542517d2ba2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bc441ba91b42c5bf060261d1e5c3ba, user_id=a72892cd617b4d4ba4e91b8724a7c062, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:45.876883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa7828-3ec4-42b9-9ed5-542517d2ba2c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:45.892059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1283/2584] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:45 2022] PUT /identity/v3/projects/e8bc441ba91b42c5bf060261d1e5c3ba/users/a72892cd617b4d4ba4e91b8724a7c062/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:45.897035 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:45.897321 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:45.897626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:45.919111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:45.921109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:45.941725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267a7ac-4fb8-4bba-9bc8-4250c59ec99b None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:46.010009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1284/2585] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:46.010478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:46.011134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:46.011418 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:46.011765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:46.012522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:46.014570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:46.029030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff659b4-c15d-4c7d-8a52-69dc721c85a5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:46.034495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:46.035487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:46.035883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:46.036158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] PATH_INFO: `/v3/projects/4b8d6ff5ff9f40c1a6fc8ad3b7858cf2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:46.037352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8d6ff5ff9f40c1a6fc8ad3b7858cf2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:46.039561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:46.084460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:46.086430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:46.090213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8d6ff5ff9f40c1a6fc8ad3b7858cf2', 'request_id': 'req-8368b430-d24c-4456-a165-ddb29ad6ca8f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.096150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1302/2586] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:46.096972 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:46.097293 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8d6ff5ff9f40c1a6fc8ad3b7858cf2', 'request_id': 'req-8368b430-d24c-4456-a165-ddb29ad6ca8f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.109990 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8d6ff5ff9f40c1a6fc8ad3b7858cf2', 'request_id': 'req-8368b430-d24c-4456-a165-ddb29ad6ca8f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.127312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] The token cache is being invalidate because project 4b8d6ff5ff9f40c1a6fc8ad3b7858cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:46.127631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.128867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.130512 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1285/2587] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:46 2022] DELETE /identity/v3/projects/4b8d6ff5ff9f40c1a6fc8ad3b7858cf2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:46.135402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:46.136992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:46.171693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd0a8-3d70-4aa9-a594-881404661c15 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:46.214581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b430-d24c-4456-a165-ddb29ad6ca8f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:46.223914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:46.224803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:46.225077 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:46.225486 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] PATH_INFO: `/v3/users/388837927afd490cb9b96b7ca600c16f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:46.229274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] RBAC: Authorizing `identity:delete_user(user_id=388837927afd490cb9b96b7ca600c16f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:46.232946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:46.263874 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:46.264545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:46.264828 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:46.265104 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:46.267315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:46.284546 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:46.286156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:46.299686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388837927afd490cb9b96b7ca600c16f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.303477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1303/2588] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:46.343575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388837927afd490cb9b96b7ca600c16f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.344261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388837927afd490cb9b96b7ca600c16f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.344893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388837927afd490cb9b96b7ca600c16f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.355255 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-757d4fea-3d69-4b19-b5f4-4e4d8cb6913a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388837927afd490cb9b96b7ca600c16f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:46.379830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1286/2589] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:46 2022] DELETE /identity/v3/users/388837927afd490cb9b96b7ca600c16f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:46.876072 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:46.886848 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a63737-48bd-421c-87c1-137f7a0a172c service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:46.969253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:46.974721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:46.974721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:46.974721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] PATH_INFO: `/v3/projects/a9502b0e81e54e248c3aafa9162f9433` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:46.981073 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9502b0e81e54e248c3aafa9162f9433)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:46.983109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.062207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9502b0e81e54e248c3aafa9162f9433', 'request_id': 'req-8199dcb6-ec73-40a5-9ae8-1decea910fc6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:47.070293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9502b0e81e54e248c3aafa9162f9433', 'request_id': 'req-8199dcb6-ec73-40a5-9ae8-1decea910fc6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:47.077505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9502b0e81e54e248c3aafa9162f9433', 'request_id': 'req-8199dcb6-ec73-40a5-9ae8-1decea910fc6'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:47.090685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] The token cache is being invalidate because project a9502b0e81e54e248c3aafa9162f9433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:47.091601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:47.092303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8199dcb6-ec73-40a5-9ae8-1decea910fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:47.094638 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1304/2590] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:46 2022] DELETE /identity/v3/projects/a9502b0e81e54e248c3aafa9162f9433 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:47.099561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad3c0-56a9-4fa6-b452-816def57e0b5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.100013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad3c0-56a9-4fa6-b452-816def57e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.100256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad3c0-56a9-4fa6-b452-816def57e0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.119085 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.119376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.119661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.131442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-63bad3c0-56a9-4fa6-b452-816def57e0b5 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:47.135615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-63bad3c0-56a9-4fa6-b452-816def57e0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:47.147903 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] MFA Rules not processed for user `a72892cd617b4d4ba4e91b8724a7c062`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:47.149098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:47.217681 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1287/2591] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:47.218629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7366-04be-4513-900b-8836142d9126 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.218918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7366-04be-4513-900b-8836142d9126 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.219196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7366-04be-4513-900b-8836142d9126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.245799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1305/2592] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:47.246085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1a1b7366-04be-4513-900b-8836142d9126 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:47.246834 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1a1b7366-04be-4513-900b-8836142d9126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:47.250359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.255111 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:47.262523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1288/2593] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:47.267484 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b7366-04be-4513-900b-8836142d9126 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.269305 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd5ba-6f78-43c2-9812-32620c9d3e34 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.274962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.275637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.275919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.276197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.276896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.278854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.300877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b7366-04be-4513-900b-8836142d9126 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.313185 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.314354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.314634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.314899 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.315627 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:47.317353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.317737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.321129 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1306/2594] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:47 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:47.324594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.335788 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1289/2595] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:47.340245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.351261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be3e68-23f2-45fc-9b95-8e28706fde18 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.422052 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706beab-c76d-4913-8d15-fc7af5b616eb admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.422431 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.423365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.423835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.424387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.425151 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.427672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.431457 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.432626 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.433015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.433308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.434085 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.436214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.468624 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1307/2596] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:47 2022] POST /identity/v3/users => generated 308 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:47.469601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1290/2597] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:47 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:47.474326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.474977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.489113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081bbca-5e1d-4bde-b00b-a720a8838756 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.626049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.626744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.627031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.627360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.628088 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.630608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.631879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb607970-a236-4bb9-b39f-e368a7ae47b5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.640867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.642143 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.642961 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.643482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.644558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.648071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.651440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1308/2598] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:47.656555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.679288 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705e30-3231-4880-9cbc-398a10e63d05 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.684514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.685417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.685733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.686011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] PATH_INFO: `/v3/projects/5ffd458e86184f24b37fc1b79bafccd1/users/daa3a250bbba48c19f58d22c6737cd01/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.694023 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1291/2599] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:47 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:47.704421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffd458e86184f24b37fc1b79bafccd1, user_id=daa3a250bbba48c19f58d22c6737cd01, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.707455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.709100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.730712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1309/2600] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:47 2022] PUT /identity/v3/projects/5ffd458e86184f24b37fc1b79bafccd1/users/daa3a250bbba48c19f58d22c6737cd01/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:47.731729 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.745420 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464cae0-71b9-4303-a991-0d28ef8fdc92 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.858300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb094c-d590-464a-90d7-de7b78dc003b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.868786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.869491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.869785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.870061 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.870786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.872392 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.874441 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.875106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.875388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.875662 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.876535 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.878203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.902187 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1310/2601] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:47.906128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1292/2602] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:47.907587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.909822 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.934699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601b17-10ef-41c5-818a-2cf26cfec48e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.938610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb292d7-f5da-497a-a4be-9675f1ac6903 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.950055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.950748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.951033 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.951163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a21b82-fc87-42d7-a1a9-22f9c3fd0441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.951326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.952028 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.952141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21b82-fc87-42d7-a1a9-22f9c3fd0441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.952571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21b82-fc87-42d7-a1a9-22f9c3fd0441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.952859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21b82-fc87-42d7-a1a9-22f9c3fd0441 admin admin] PATH_INFO: `/v3/projects/5ffd458e86184f24b37fc1b79bafccd1/users/daa3a250bbba48c19f58d22c6737cd01/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:47.953829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.966641 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1293/2603] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:47.970278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:47.977799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a21b82-fc87-42d7-a1a9-22f9c3fd0441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffd458e86184f24b37fc1b79bafccd1, user_id=daa3a250bbba48c19f58d22c6737cd01, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:47.981365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b344-de76-4385-b488-57b3c1ae0f5d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:47.983745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a21b82-fc87-42d7-a1a9-22f9c3fd0441 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:47.990717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:47.993176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:47.994305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:47.994800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] PATH_INFO: `/v3/projects/b3a92ee23b254773b15913925c809725/users/eba010935d7d4017929c8c487f331972/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.004128 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1311/2604] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:47 2022] PUT /identity/v3/projects/5ffd458e86184f24b37fc1b79bafccd1/users/daa3a250bbba48c19f58d22c6737cd01/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:48.015498 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a92ee23b254773b15913925c809725, user_id=eba010935d7d4017929c8c487f331972, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:48.018791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:48.049687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1294/2605] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:47 2022] PUT /identity/v3/projects/b3a92ee23b254773b15913925c809725/users/eba010935d7d4017929c8c487f331972/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:48.056804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07afc-f6c4-4e7e-b4b4-e7403f143be7 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:48.057119 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07afc-f6c4-4e7e-b4b4-e7403f143be7 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:48.057646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07afc-f6c4-4e7e-b4b4-e7403f143be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.100244 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-79e07afc-f6c4-4e7e-b4b4-e7403f143be7 None None] MFA Rules not processed for user `eba010935d7d4017929c8c487f331972`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:48.101588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-79e07afc-f6c4-4e7e-b4b4-e7403f143be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:48.210800 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1312/2606] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:48.215676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:48.320652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ae90-4de0-4343-87ce-b9376e9a4278 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:48.328715 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:48.330101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:48.330426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:48.330746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.331896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:48.334624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:48.372856 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1295/2607] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:48 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:48.376957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07afc-f6c4-4e7e-b4b4-e7403f143be7 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:48.397068 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07afc-f6c4-4e7e-b4b4-e7403f143be7 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:48.554445 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:48.555148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:48.555464 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:48.555723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.559311 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:48.561284 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:48.600349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1313/2608] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:48 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:48.601934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:48.622340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7064423-bf73-46a0-920e-e12abd6ca878 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:48.628370 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:48.629334 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:48.629884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:48.630405 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.632349 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:48.634745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:48.647693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1296/2609] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:48.652197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:48.667834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f3224-ae78-41c6-94f0-ccfd985c7999 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:48.691643 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:48.692421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:48.692672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:48.692975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] PATH_INFO: `/v3/projects/00b030b2f9574fa7a402ba7d293e21f9/users/c7dd73f5c93046c29a68dee1677662df/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.727208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b030b2f9574fa7a402ba7d293e21f9, user_id=c7dd73f5c93046c29a68dee1677662df, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:48.736527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:48.777830 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1314/2610] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:48 2022] PUT /identity/v3/projects/00b030b2f9574fa7a402ba7d293e21f9/users/c7dd73f5c93046c29a68dee1677662df/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:48.779052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:48.795289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37546-7dd0-4817-9e36-c2cf3b5e1b61 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:48.933034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e178b-742b-4ce3-af42-e55058c031f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:48.933736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e178b-742b-4ce3-af42-e55058c031f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:48.934011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e178b-742b-4ce3-af42-e55058c031f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:48.934638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e178b-742b-4ce3-af42-e55058c031f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.935007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e178b-742b-4ce3-af42-e55058c031f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:48.937068 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e178b-742b-4ce3-af42-e55058c031f2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:48.951392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1297/2611] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:48.955505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:48.970220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc99c2-e267-47d6-8066-dfe2737e46d0 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:48.975444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:48.976875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:48.977350 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:48.977991 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] PATH_INFO: `/v3/projects/00b030b2f9574fa7a402ba7d293e21f9/users/c7dd73f5c93046c29a68dee1677662df/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:48.980609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b030b2f9574fa7a402ba7d293e21f9, user_id=c7dd73f5c93046c29a68dee1677662df, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:48.983706 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:48.997625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1315/2612] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:48 2022] PUT /identity/v3/projects/00b030b2f9574fa7a402ba7d293e21f9/users/c7dd73f5c93046c29a68dee1677662df/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:49.007886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9c4d3-6ef1-422f-a0ee-6d165286d1c9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:49.008175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9c4d3-6ef1-422f-a0ee-6d165286d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:49.008440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9c4d3-6ef1-422f-a0ee-6d165286d1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:49.043476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4ef9c4d3-6ef1-422f-a0ee-6d165286d1c9 None None] MFA Rules not processed for user `c7dd73f5c93046c29a68dee1677662df`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:49.046311 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4ef9c4d3-6ef1-422f-a0ee-6d165286d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:49.158972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1298/2613] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:49.170510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:49.172507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:49.247070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643d32-3470-4393-be43-e7348d0d1677 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:49.251585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:49.252429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:49.252777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:49.253113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:49.266844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:49.268420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:49.278896 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1316/2614] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:49.360689 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60a42f-6ad3-4cbe-8cac-16e6b4428de6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:49.361832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60a42f-6ad3-4cbe-8cac-16e6b4428de6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:49.362259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60a42f-6ad3-4cbe-8cac-16e6b4428de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:49.379020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:49.412036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6f60a42f-6ad3-4cbe-8cac-16e6b4428de6 None None] MFA Rules not processed for user `daa3a250bbba48c19f58d22c6737cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:49.416071 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6f60a42f-6ad3-4cbe-8cac-16e6b4428de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:49.490689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d36d7-d938-4399-8733-33345761fc76 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:49.508891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:49.510109 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:49.510390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:49.510650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] PATH_INFO: `/v3/users/eba010935d7d4017929c8c487f331972` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:49.514829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba010935d7d4017929c8c487f331972)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:49.517024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:49.552943 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1299/2615] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:49.604906 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba010935d7d4017929c8c487f331972'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:49.612492 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba010935d7d4017929c8c487f331972'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:49.613231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba010935d7d4017929c8c487f331972'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:49.633543 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba010935d7d4017929c8c487f331972'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:49.635275 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba010935d7d4017929c8c487f331972'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:49.706009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1317/2616] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:49 2022] DELETE /identity/v3/users/eba010935d7d4017929c8c487f331972 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:49.707717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:49.708003 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:49.708456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:49.742427 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:49.743696 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:49.831684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1300/2617] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:49.845229 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:49.846349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:50.000801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbee4a-c102-432d-b1e8-82b50c2ba984 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:50.007049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0e167-a193-4391-bc10-c9964d3ffca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:50.007832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0e167-a193-4391-bc10-c9964d3ffca1 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:50.008218 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0e167-a193-4391-bc10-c9964d3ffca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:50.008586 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0e167-a193-4391-bc10-c9964d3ffca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:50.022610 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0e167-a193-4391-bc10-c9964d3ffca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:50.025907 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0e167-a193-4391-bc10-c9964d3ffca1 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:50.038810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1318/2618] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:50.204352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:50.206198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:50.219721 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090edf4-9923-4079-9941-52418a2f9a21 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:50.235513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:50.236254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:50.236651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:50.237015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] PATH_INFO: `/v3/users/597a73a146564979b3db7c7154678fef` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:50.238433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597a73a146564979b3db7c7154678fef)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:50.240452 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:50.348531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597a73a146564979b3db7c7154678fef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.363473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597a73a146564979b3db7c7154678fef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.364220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597a73a146564979b3db7c7154678fef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.365228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597a73a146564979b3db7c7154678fef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.374328 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597a73a146564979b3db7c7154678fef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.395206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1301/2619] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:50 2022] DELETE /identity/v3/users/597a73a146564979b3db7c7154678fef => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:50.399249 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:50.400146 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:50.400437 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:50.423431 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:50.424804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:50.545092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1319/2620] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:50.569744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:50.575066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:50.638595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11a7c-0a85-48d9-909e-78ebfeb0ee54 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:50.642618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:50.643350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:50.643898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:50.644239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:50.654639 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:50.656549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:50.667234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1302/2621] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:50.778149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:50.779571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:50.792019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacaa50e-bc7d-47b0-a198-e301d0d1583e None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:50.796888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:50.797989 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:50.798270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:50.798725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] PATH_INFO: `/v3/projects/b3a92ee23b254773b15913925c809725` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:50.800289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a92ee23b254773b15913925c809725)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:50.802460 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:50.869588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a92ee23b254773b15913925c809725', 'request_id': 'req-62839599-0acb-44b4-9079-a4c1eb8d3308'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.886208 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a92ee23b254773b15913925c809725', 'request_id': 'req-62839599-0acb-44b4-9079-a4c1eb8d3308'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.896426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a92ee23b254773b15913925c809725', 'request_id': 'req-62839599-0acb-44b4-9079-a4c1eb8d3308'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.908181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] The token cache is being invalidate because project b3a92ee23b254773b15913925c809725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:50.908730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.909395 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:50.911030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1320/2622] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:50 2022] DELETE /identity/v3/projects/b3a92ee23b254773b15913925c809725 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:50.915005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:50.927111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765121e9-4f12-415b-94d9-04c14a2139b3 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.013710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.014697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.015085 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.015468 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] PATH_INFO: `/v3/users/c7dd73f5c93046c29a68dee1677662df` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.017039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7dd73f5c93046c29a68dee1677662df)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.019103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.077341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7dd73f5c93046c29a68dee1677662df'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.087406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7dd73f5c93046c29a68dee1677662df'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.088110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7dd73f5c93046c29a68dee1677662df'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.088744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7dd73f5c93046c29a68dee1677662df'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.093581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.095050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.096563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c85d40b7-4cef-45b9-8de3-922fb1769f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7dd73f5c93046c29a68dee1677662df'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.123499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1303/2623] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:50 2022] DELETE /identity/v3/users/c7dd73f5c93046c29a68dee1677662df => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:51.134321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62839599-0acb-44b4-9079-a4c1eb8d3308 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.203625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.204756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.205192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.205650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] PATH_INFO: `/v3/projects/36c610409cb149ba80a572998437aa0c` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.208742 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c610409cb149ba80a572998437aa0c)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.211236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.276220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c610409cb149ba80a572998437aa0c', 'request_id': 'req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.288124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c610409cb149ba80a572998437aa0c', 'request_id': 'req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.297709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c610409cb149ba80a572998437aa0c', 'request_id': 'req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.310728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] The token cache is being invalidate because project 36c610409cb149ba80a572998437aa0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:51.311023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.312293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.318147 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1321/2624] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:51 2022] DELETE /identity/v3/projects/36c610409cb149ba80a572998437aa0c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:51.319999 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9afd-7056-4579-b5b2-525b9944d166 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.320464 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9afd-7056-4579-b5b2-525b9944d166 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.320815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9afd-7056-4579-b5b2-525b9944d166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.345433 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.348166 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.353570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-485f9afd-7056-4579-b5b2-525b9944d166 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:51.355190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-485f9afd-7056-4579-b5b2-525b9944d166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.453036 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1304/2625] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:51.463092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.463586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.464142 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.474538 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8eaa-bfea-4a22-b8f1-e2c3c0128d3a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.488837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:51.490353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.494902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.495805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.496092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.496382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] PATH_INFO: `/v3/users/a72892cd617b4d4ba4e91b8724a7c062` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.502182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72892cd617b4d4ba4e91b8724a7c062)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.502437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1305/2626] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:51.503573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.504363 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.505847 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.518644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd95f9-e965-48ff-81ee-2ab7f5423250 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.523685 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.524710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.525175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.525753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] PATH_INFO: `/v3/projects/00b030b2f9574fa7a402ba7d293e21f9` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.527203 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b030b2f9574fa7a402ba7d293e21f9)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.530184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.574203 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72892cd617b4d4ba4e91b8724a7c062'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.586517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72892cd617b4d4ba4e91b8724a7c062'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.587300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72892cd617b4d4ba4e91b8724a7c062'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.599675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72892cd617b4d4ba4e91b8724a7c062'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.601544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72892cd617b4d4ba4e91b8724a7c062'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.609998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b030b2f9574fa7a402ba7d293e21f9', 'request_id': 'req-8129694b-ef07-40c0-a831-7ae060ab39cc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.620190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b030b2f9574fa7a402ba7d293e21f9', 'request_id': 'req-8129694b-ef07-40c0-a831-7ae060ab39cc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.622289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1322/2627] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:51 2022] DELETE /identity/v3/users/a72892cd617b4d4ba4e91b8724a7c062 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:51.626614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.627872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.632507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b030b2f9574fa7a402ba7d293e21f9', 'request_id': 'req-8129694b-ef07-40c0-a831-7ae060ab39cc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.644695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] The token cache is being invalidate because project 00b030b2f9574fa7a402ba7d293e21f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:51.645371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.646329 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8129694b-ef07-40c0-a831-7ae060ab39cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.648867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1306/2628] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:51 2022] DELETE /identity/v3/projects/00b030b2f9574fa7a402ba7d293e21f9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:51.653573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594caa1-cdbd-4110-817c-9b6b7fe8bd1b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.653864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594caa1-cdbd-4110-817c-9b6b7fe8bd1b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.654144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594caa1-cdbd-4110-817c-9b6b7fe8bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.678896 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0594caa1-cdbd-4110-817c-9b6b7fe8bd1b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:51.683522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0594caa1-cdbd-4110-817c-9b6b7fe8bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.703269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3b85-539d-444c-a002-85015da40274 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.710450 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.711139 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.711408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.711737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.713172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:51.713367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.715558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.731900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1323/2629] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:51.736300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.738319 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.751521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c84725-096c-4778-91da-658ce11ab4fd admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.758325 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.759509 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.760057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.760182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.760834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.767339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1307/2630] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:51.767517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.772192 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.772686 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.772985 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.796738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1324/2631] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:51 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:51.799220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:51.800624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.800988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.878100 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f27d8-e464-4619-8e35-5cd1e26200c6 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.885947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.886657 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.886936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.887212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.887952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.889886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.909673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1308/2632] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:51.909673 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.909987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:51.915885 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1325/2633] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:51 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:51.916948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.921680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452862e-5eae-4fba-92b7-d56835f7f665 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.926230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.926454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2ef8-0670-4ffe-bcbb-5f377a60019e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.927074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.927356 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.927629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] PATH_INFO: `/v3/projects/e8bc441ba91b42c5bf060261d1e5c3ba` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.928765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bc441ba91b42c5bf060261d1e5c3ba)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.931491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.932011 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.932646 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.932929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.933200 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.933942 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:51.934271 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.935927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.948718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1326/2634] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:51.949576 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.958869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e5c9e-a982-4490-bb89-9ff800516b14 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.964056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:51.964716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:51.964996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:51.965272 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:51.966037 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:51.967618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:51.978652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1327/2635] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:51.979483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:51.983744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bc441ba91b42c5bf060261d1e5c3ba', 'request_id': 'req-f1e17d35-85aa-48fe-be5b-fd80828a6470'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.989188 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bc441ba91b42c5bf060261d1e5c3ba', 'request_id': 'req-f1e17d35-85aa-48fe-be5b-fd80828a6470'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:51.991607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fc888-65d0-41e7-b441-56a01359a142 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:51.998209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bc441ba91b42c5bf060261d1e5c3ba', 'request_id': 'req-f1e17d35-85aa-48fe-be5b-fd80828a6470'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.012271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] The token cache is being invalidate because project e8bc441ba91b42c5bf060261d1e5c3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:52.012509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.013278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.016317 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1309/2636] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:51 2022] DELETE /identity/v3/projects/e8bc441ba91b42c5bf060261d1e5c3ba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:52.017122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.020711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.051018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.051674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.051949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.052219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.052888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.054805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.083908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1328/2637] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:51 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:52.083908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.085879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.087550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17d35-85aa-48fe-be5b-fd80828a6470 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.141998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.142578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.142861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.143131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.143845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.145437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.146578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738a44-6198-4dc4-b274-9f1241e78e86 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.151153 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.152007 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.152285 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.152555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] PATH_INFO: `/v3/users/daa3a250bbba48c19f58d22c6737cd01` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.153797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa3a250bbba48c19f58d22c6737cd01)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.154905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1310/2638] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:52.155693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.155810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.159551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.171731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac103a-f60e-4ea2-9094-014b157f9841 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.176235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.176881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.177184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.177428 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.178116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.180158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.203634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1311/2639] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:52.203634 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.203902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa3a250bbba48c19f58d22c6737cd01'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.209668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa3a250bbba48c19f58d22c6737cd01'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.210354 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa3a250bbba48c19f58d22c6737cd01'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.211110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5590-a17d-4803-98f3-f3e0e8f1b3e8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.216092 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9cc3-8fab-432e-a616-b1c3034a94b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.217155 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9cc3-8fab-432e-a616-b1c3034a94b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.217439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9cc3-8fab-432e-a616-b1c3034a94b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.217904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9cc3-8fab-432e-a616-b1c3034a94b6 admin admin] PATH_INFO: `/v3/projects/a92a32956353454db32509526ff751da/users/0e0b0f5728f244578741648259bbcd59/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.218465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa3a250bbba48c19f58d22c6737cd01'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.219084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa3a250bbba48c19f58d22c6737cd01'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.232522 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd9cc3-8fab-432e-a616-b1c3034a94b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92a32956353454db32509526ff751da, user_id=0e0b0f5728f244578741648259bbcd59, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.235253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd9cc3-8fab-432e-a616-b1c3034a94b6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.236441 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1329/2640] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:52 2022] DELETE /identity/v3/users/daa3a250bbba48c19f58d22c6737cd01 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:52.237254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.238948 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.253728 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1312/2641] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:52 2022] PUT /identity/v3/projects/a92a32956353454db32509526ff751da/users/0e0b0f5728f244578741648259bbcd59/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:52.259711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.260007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.260285 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.278947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:52.280157 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.311256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3fdc1-0743-4a67-bef1-a7d8575cc995 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.344442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1313/2642] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:52.351753 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.353871 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.374555 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.375612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.375961 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.376230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.377081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.378734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.389359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1330/2643] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:52.393766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.403219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefd1e1-0a5d-4819-8b6c-edb0bd16e93a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.408093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.408811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.409136 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.409532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.410251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.411829 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.424170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6af33-cab8-41f5-877a-02ec49227f3e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.427912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1331/2644] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:52.428133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.428768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.428922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.429392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.429392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.431678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.440602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.442101 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.444404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263dfd-e088-4339-a033-ccc914531db5 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.449887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.452296 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1314/2645] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:52.453339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.456443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.456804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.457161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] PATH_INFO: `/v3/projects/5ffd458e86184f24b37fc1b79bafccd1` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.458685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffd458e86184f24b37fc1b79bafccd1)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.460748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.463740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846cf7-4e00-400e-abdd-5ea9dca2eeed service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.469236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96554a76-fac3-41b0-9783-4af7b27b6485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.470114 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96554a76-fac3-41b0-9783-4af7b27b6485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.470403 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96554a76-fac3-41b0-9783-4af7b27b6485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.470674 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96554a76-fac3-41b0-9783-4af7b27b6485 admin admin] PATH_INFO: `/v3/projects/51955e3298394dfc805894c208a6a8ea/users/5af083589b2142b3870604ccd3f3ebec/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.489073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96554a76-fac3-41b0-9783-4af7b27b6485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51955e3298394dfc805894c208a6a8ea, user_id=5af083589b2142b3870604ccd3f3ebec, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.491991 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96554a76-fac3-41b0-9783-4af7b27b6485 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.522900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1315/2646] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:52 2022] PUT /identity/v3/projects/51955e3298394dfc805894c208a6a8ea/users/5af083589b2142b3870604ccd3f3ebec/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:52.525584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.525946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.526274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.527594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffd458e86184f24b37fc1b79bafccd1', 'request_id': 'req-36873b6b-b0c1-4810-8731-5acffc510506'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.536385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffd458e86184f24b37fc1b79bafccd1', 'request_id': 'req-36873b6b-b0c1-4810-8731-5acffc510506'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.542744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffd458e86184f24b37fc1b79bafccd1', 'request_id': 'req-36873b6b-b0c1-4810-8731-5acffc510506'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.554868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] The token cache is being invalidate because project 5ffd458e86184f24b37fc1b79bafccd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:52.555231 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.556549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-36873b6b-b0c1-4810-8731-5acffc510506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:52.558941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1332/2647] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:52 2022] DELETE /identity/v3/projects/5ffd458e86184f24b37fc1b79bafccd1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:52.560252 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] MFA Rules not processed for user `5af083589b2142b3870604ccd3f3ebec`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:52.562244 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.563246 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b472c0-4e56-4791-afa3-a0668e8aa253 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.563592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b472c0-4e56-4791-afa3-a0668e8aa253 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.563973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b472c0-4e56-4791-afa3-a0668e8aa253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.596096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-60b472c0-4e56-4791-afa3-a0668e8aa253 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:52.598614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-60b472c0-4e56-4791-afa3-a0668e8aa253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.643087 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1316/2648] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:52.648148 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.651140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.677150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1333/2649] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:52.680356 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b958-cb26-42d2-8fbb-42ac88aef6be None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.680678 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b958-cb26-42d2-8fbb-42ac88aef6be None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.680958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b958-cb26-42d2-8fbb-42ac88aef6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.710768 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-bb31b958-cb26-42d2-8fbb-42ac88aef6be None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:52.712811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bb31b958-cb26-42d2-8fbb-42ac88aef6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:52.721527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1334/2650] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:52.725212 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31b958-cb26-42d2-8fbb-42ac88aef6be None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.737287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31b958-cb26-42d2-8fbb-42ac88aef6be None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.744652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.745998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.746452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.746785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.748050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:52.748141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.750840 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.770957 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1335/2651] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:52.771429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.792407 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1499-553a-497b-8129-aebfecf41d76 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.795590 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee21982-970b-4e79-880b-5bbf5bff5cbe admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.799391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.800097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.800463 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.800746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.802161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.805234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.812117 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.812791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.813193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.813505 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.814206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.816080 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.845327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1317/2652] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:52.849423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.862387 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1336/2653] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/projects => generated 357 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:52.867859 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:52.927191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaaba1-1086-44f4-b7de-043c14dd953c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.948362 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb8ef-4ae6-4160-bea3-1ce05923d97b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:52.955981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:52.957097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:52.957668 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:52.958315 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:52.959388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:52.963154 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:52.995064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1337/2654] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/users => generated 279 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:52.999521 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.011007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.011375 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435c800-2bf3-4dc4-9fba-b7cefee7264c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.012022 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.012242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.012520 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.013200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.016282 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.017980 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.018658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.018936 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.019210 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.020535 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.022421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.034866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1338/2655] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:53.038810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.044111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1318/2656] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:52 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:53.048005 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.059366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363bac-fe33-40da-a756-474e424bddfb admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.059519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2619b5f-5c09-49dd-ba84-dfecf405c2c2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.064803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.065533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.065829 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.066112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.066863 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.067085 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.068105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.068552 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.068731 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.068847 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.069559 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.071975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.080392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1319/2657] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:53.083664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1339/2658] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:53.088076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.088310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.098131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead321-a576-4c05-8246-ddde35caf518 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.098702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974c5e-d9c4-44fc-89d4-ff785d060da8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.103014 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc443a-10af-4a74-baa6-c81672a69a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.103539 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.104040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc443a-10af-4a74-baa6-c81672a69a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.104393 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc443a-10af-4a74-baa6-c81672a69a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.104596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.104804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc443a-10af-4a74-baa6-c81672a69a7e admin admin] PATH_INFO: `/v3/projects/4f2f74cc3b6a494e80fa38e2e17c7032/users/b91fc5f0f69540ab9c7ca4e9772f932c/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.104992 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.105358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] PATH_INFO: `/v3/projects/53ba3beed39a4af9b7fbf4cbcf106c5a/users/41f8ecec23254a529ea4df51fd568f97/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.120749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc443a-10af-4a74-baa6-c81672a69a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2f74cc3b6a494e80fa38e2e17c7032, user_id=b91fc5f0f69540ab9c7ca4e9772f932c, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.121589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ba3beed39a4af9b7fbf4cbcf106c5a, user_id=41f8ecec23254a529ea4df51fd568f97, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.124170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc443a-10af-4a74-baa6-c81672a69a7e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.124389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.141842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1340/2659] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:53 2022] PUT /identity/v3/projects/53ba3beed39a4af9b7fbf4cbcf106c5a/users/41f8ecec23254a529ea4df51fd568f97/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:53.143547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1320/2660] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:53 2022] PUT /identity/v3/projects/4f2f74cc3b6a494e80fa38e2e17c7032/users/b91fc5f0f69540ab9c7ca4e9772f932c/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:53.151928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.152771 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f4c5-5ef4-4b85-ade9-d8b678f152c3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.153156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f4c5-5ef4-4b85-ade9-d8b678f152c3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.153575 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f4c5-5ef4-4b85-ade9-d8b678f152c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.184235 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e766f4c5-5ef4-4b85-ade9-d8b678f152c3 None None] MFA Rules not processed for user `41f8ecec23254a529ea4df51fd568f97`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:53.185610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e766f4c5-5ef4-4b85-ade9-d8b678f152c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:53.239582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154a456-67b6-44fa-b077-29f26476c354 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.282342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1321/2661] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:53.283697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f4c5-5ef4-4b85-ade9-d8b678f152c3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.321924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.322595 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.322880 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.323160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.323940 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.326190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.340915 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1341/2662] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:53.341979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.353965 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121e89b-aaa1-4ec6-813e-4c9fc6ccde2a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.359185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a93bb8-491c-449c-b691-92b703460b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.360121 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93bb8-491c-449c-b691-92b703460b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.360403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93bb8-491c-449c-b691-92b703460b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.360675 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93bb8-491c-449c-b691-92b703460b72 admin admin] PATH_INFO: `/v3/projects/4f2f74cc3b6a494e80fa38e2e17c7032/users/b91fc5f0f69540ab9c7ca4e9772f932c/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.363219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a93bb8-491c-449c-b691-92b703460b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2f74cc3b6a494e80fa38e2e17c7032, user_id=b91fc5f0f69540ab9c7ca4e9772f932c, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.366292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a93bb8-491c-449c-b691-92b703460b72 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.371977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f4c5-5ef4-4b85-ade9-d8b678f152c3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.382430 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1342/2663] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:53 2022] PUT /identity/v3/projects/4f2f74cc3b6a494e80fa38e2e17c7032/users/b91fc5f0f69540ab9c7ca4e9772f932c/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:53.393046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.393408 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.393765 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.431054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] MFA Rules not processed for user `b91fc5f0f69540ab9c7ca4e9772f932c`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:53.433175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:53.441396 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.442117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.442398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.442672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.443354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.445553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.485658 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1322/2664] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:53 2022] POST /identity/v3/projects => generated 357 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:53.490027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.535798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1343/2665] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:53.549316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.551499 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:53.570895 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f876b-c369-43a2-b11d-c42a86edd119 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.578391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.579075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.579355 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.579628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.580497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.583272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.613657 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1323/2666] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:53 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:53.615040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.627670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e65cd-c789-4c7a-9273-a1841bc44448 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.631728 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad111-4ac3-4936-8b44-40b0047d7b33 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.633227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.634592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.634592 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.634840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.635475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.637278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.650228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1324/2667] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:53.653951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.665862 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd9c65-bb1c-44e5-9b0c-432cb0fa3732 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.671363 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.672335 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.672679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.673075 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] PATH_INFO: `/v3/projects/59768fba9c114e3f87d3bdc73f29f873/users/eef1061a882845059143537424ef0c78/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.689359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59768fba9c114e3f87d3bdc73f29f873, user_id=eef1061a882845059143537424ef0c78, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.692359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.698112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.698891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.699220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.699520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.709361 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1325/2668] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:53 2022] PUT /identity/v3/projects/59768fba9c114e3f87d3bdc73f29f873/users/eef1061a882845059143537424ef0c78/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:53.714632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.785077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.786908 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.787218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f706b-af39-4c5a-b59c-93a3ad409b35 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.793436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.794650 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.795118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.795621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.796736 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.798889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.799516 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1344/2669] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:53.813825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1326/2670] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:53.815287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.846097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc2b4-afde-4338-9081-195839eb4045 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.863812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f867b-d59b-4f05-9e26-7c806a0e95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.864724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f867b-d59b-4f05-9e26-7c806a0e95d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.865000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f867b-d59b-4f05-9e26-7c806a0e95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.865269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f867b-d59b-4f05-9e26-7c806a0e95d0 admin admin] PATH_INFO: `/v3/projects/59768fba9c114e3f87d3bdc73f29f873/users/eef1061a882845059143537424ef0c78/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.867229 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:53.871089 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:53.880225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f867b-d59b-4f05-9e26-7c806a0e95d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59768fba9c114e3f87d3bdc73f29f873, user_id=eef1061a882845059143537424ef0c78, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.882926 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f867b-d59b-4f05-9e26-7c806a0e95d0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.889450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2d5c-5da5-41f6-b274-d20d278dda46 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:53.906886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1345/2671] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:53 2022] PUT /identity/v3/projects/59768fba9c114e3f87d3bdc73f29f873/users/eef1061a882845059143537424ef0c78/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:53.917718 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.918155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.918707 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.919051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:53.919938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:53.920213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:53.920541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] PATH_INFO: `/v3/users/5c1707bc7df54e32b70c222e2f637630` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:53.922615 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1707bc7df54e32b70c222e2f637630)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:53.924533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:53.979410 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] MFA Rules not processed for user `eef1061a882845059143537424ef0c78`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:53.982214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:53.998011 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1707bc7df54e32b70c222e2f637630'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:54.015490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1707bc7df54e32b70c222e2f637630'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:54.016481 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1707bc7df54e32b70c222e2f637630'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:54.017283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1707bc7df54e32b70c222e2f637630'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:54.031162 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-754d232e-8272-4a7c-9a49-ad14ca0532cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1707bc7df54e32b70c222e2f637630'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:54.071867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1327/2672] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:53 2022] DELETE /identity/v3/users/5c1707bc7df54e32b70c222e2f637630 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:54.078790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.078790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.078790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.107542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:54.109076 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:54.126313 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1346/2673] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:53 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:54.152462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.154230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:54.206560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1328/2674] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:54.215891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.217875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:54.238106 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8314c09-9169-4c0d-99e3-123fc14f6040 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.303925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb403-0838-4a0e-b6e1-4aa7279a974c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.319078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.319669 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.319946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.320219 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.337027 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.337857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.338778 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.339057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.340314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.342125 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:54.355972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1329/2675] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:54.357358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.359112 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:54.448160 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1415f9-3e44-4c55-a436-5ef47c25cf34 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.453799 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91fc5f0f69540ab9c7ca4e9772f932c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2f74cc3b6a494e80fa38e2e17c7032', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.454679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.455196 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.455629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.456565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:54.457043 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.460418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:54.471858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.474009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:54.487713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1330/2676] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:54.488730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.497670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1347/2677] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:54 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:54.504338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1bda6-ebef-485b-bed5-9618cdb379fb tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.510665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91fc5f0f69540ab9c7ca4e9772f932c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2f74cc3b6a494e80fa38e2e17c7032', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.512206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.512499 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.512806 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.514388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.517398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:54.558138 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1331/2678] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:54 2022] POST /identity/v3/projects => generated 353 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:54.566008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.596398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f000e-2311-4552-94fe-489367c1d06c service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.627663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.697482 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91fc5f0f69540ab9c7ca4e9772f932c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2f74cc3b6a494e80fa38e2e17c7032', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.698681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.698970 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.699253 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.699984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:54.700293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.702838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:54.721602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1348/2679] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:54.746221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa7934-e4a6-492d-a567-0b7409e4ad7a tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.757133 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.759581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.759983 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.760490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.766938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:54.784650 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.786947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:54.871492 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.873048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:54.887000 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ccbfb-d0ce-461a-8d5a-fae0c6dbff39 tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.893070 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1332/2680] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:54 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:54.893989 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:54.903370 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.904331 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.904615 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.904889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] PATH_INFO: `/v3/projects/13837d1584fb48ed8bc8d623444af41d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.907245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=13837d1584fb48ed8bc8d623444af41d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.909164 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:54.909911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77258ca5-7224-408b-917c-1ca39579c7fe service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:54.915012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91fc5f0f69540ab9c7ca4e9772f932c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2f74cc3b6a494e80fa38e2e17c7032', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:54.919877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:54.920176 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:54.920466 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] PATH_INFO: `/v3/projects/1b670914e9e74004ad390723767c2959` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:54.922539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b670914e9e74004ad390723767c2959)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:54.925305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.021504 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13837d1584fb48ed8bc8d623444af41d', 'request_id': 'req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.034637 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13837d1584fb48ed8bc8d623444af41d', 'request_id': 'req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.039234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b670914e9e74004ad390723767c2959', 'request_id': 'req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.044204 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13837d1584fb48ed8bc8d623444af41d', 'request_id': 'req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.055523 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b670914e9e74004ad390723767c2959', 'request_id': 'req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.058520 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] The token cache is being invalidate because project 13837d1584fb48ed8bc8d623444af41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:55.058811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.059484 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-3a9310aa-1aad-4bce-8ae9-1f64a7c8d6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.061259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1349/2681] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:54 2022] DELETE /identity/v3/projects/13837d1584fb48ed8bc8d623444af41d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:55.066512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244c19e-fd2c-4f05-93ba-78fb9379ebd9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.066984 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244c19e-fd2c-4f05-93ba-78fb9379ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.067425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244c19e-fd2c-4f05-93ba-78fb9379ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.069903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b670914e9e74004ad390723767c2959', 'request_id': 'req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.082843 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] The token cache is being invalidate because project 1b670914e9e74004ad390723767c2959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:55.083132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.083869 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8b09a5f2-a73c-44cd-98fc-a10bdf72831b tempest-VolumeQuotaClassesTest-894913136 tempest-VolumeQuotaClassesTest-894913136-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.085426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1333/2682] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:54 2022] DELETE /identity/v3/projects/1b670914e9e74004ad390723767c2959 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:55.119158 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4244c19e-fd2c-4f05-93ba-78fb9379ebd9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:55.126750 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4244c19e-fd2c-4f05-93ba-78fb9379ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:55.229762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1350/2683] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:55.232288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6119b7-f231-4217-98ea-efb5cbcb055e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.232561 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6119b7-f231-4217-98ea-efb5cbcb055e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.232883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6119b7-f231-4217-98ea-efb5cbcb055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.260024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bf6119b7-f231-4217-98ea-efb5cbcb055e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:55.261226 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bf6119b7-f231-4217-98ea-efb5cbcb055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:55.277268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244c19e-fd2c-4f05-93ba-78fb9379ebd9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.277502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1334/2684] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:13:55.289656 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244c19e-fd2c-4f05-93ba-78fb9379ebd9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.295087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.296082 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.296563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.297133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.298134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:55.298444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.300099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.314309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1351/2685] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:55.318359 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6119b7-f231-4217-98ea-efb5cbcb055e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.333690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6119b7-f231-4217-98ea-efb5cbcb055e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.339441 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.340116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.340389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.340691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.341811 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.343680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.381151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.384092 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:55.385063 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1335/2686] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:55 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:55.386042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.410979 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e687c4-8f39-4d1f-9f46-82101286fe15 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.479001 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3366e-51fb-4834-95d8-abe95e201bb4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.486634 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.487592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.487950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.488298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] PATH_INFO: `/v3/users/5af083589b2142b3870604ccd3f3ebec` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.489714 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af083589b2142b3870604ccd3f3ebec)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.491152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.491898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.493954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.494455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.494911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.495815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.498126 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.530338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1336/2687] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:55 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:55.534739 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.547602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece34acb-da65-4b6f-8ba2-4f86b10196d0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.552631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.553312 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.553635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.553905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.554640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.557020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.563958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af083589b2142b3870604ccd3f3ebec'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.571727 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1337/2688] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:55.572790 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.574476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af083589b2142b3870604ccd3f3ebec'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.575923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af083589b2142b3870604ccd3f3ebec'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.586314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6642a8-ba80-472c-9b77-d8dfbab71ecf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.589951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af083589b2142b3870604ccd3f3ebec'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.591169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-72d3959b-54a4-4c43-a86a-eb5bac63ea8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af083589b2142b3870604ccd3f3ebec'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:55.592178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.592866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.593198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.593497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.594394 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.596207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.615833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1338/2689] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:55.617412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.620609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1352/2690] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:55 2022] DELETE /identity/v3/users/5af083589b2142b3870604ccd3f3ebec => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:55.620882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:55.624988 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.625851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.630571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.633977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f623f1b-b142-468a-82b7-fbf2536b9976 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.671820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:55.675923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:55.723866 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f088-18b4-466a-bf74-773dc6273c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.725429 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f088-18b4-466a-bf74-773dc6273c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.726217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f088-18b4-466a-bf74-773dc6273c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.728107 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f088-18b4-466a-bf74-773dc6273c23 admin admin] PATH_INFO: `/v3/projects/cc0c73a5efc84e348363ae368873f51d/users/1fa0cd8ed723418daf1cbd6933e0ce6b/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.749905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636f088-18b4-466a-bf74-773dc6273c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0c73a5efc84e348363ae368873f51d, user_id=1fa0cd8ed723418daf1cbd6933e0ce6b, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.754054 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636f088-18b4-466a-bf74-773dc6273c23 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.759514 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1353/2691] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:55.771084 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.775089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:55.781338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1339/2692] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:55 2022] PUT /identity/v3/projects/cc0c73a5efc84e348363ae368873f51d/users/1fa0cd8ed723418daf1cbd6933e0ce6b/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:55.786423 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc736e91-edf2-40b6-8d70-fc84cc411743 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.786756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc736e91-edf2-40b6-8d70-fc84cc411743 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.787037 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc736e91-edf2-40b6-8d70-fc84cc411743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.809879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bc736e91-edf2-40b6-8d70-fc84cc411743 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:55.811951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bc736e91-edf2-40b6-8d70-fc84cc411743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:55.859836 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77777f5c-7f1b-4107-82f4-ca4b1f52cec3 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.892371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1340/2693] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:55.903464 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc736e91-edf2-40b6-8d70-fc84cc411743 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:55.933781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.934449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.934731 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.935569 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:55.950579 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:55.952760 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:55.982426 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1354/2694] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:55.986482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc736e91-edf2-40b6-8d70-fc84cc411743 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:55.992436 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:55.993221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:55.993637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:55.993980 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:56.008288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:56.010667 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:56.024095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1341/2695] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:13:56.525054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:56.526701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:56.544806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18c7f8-f0a8-439c-9629-3e5a105ca534 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:56.553151 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:56.554377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:56.554762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:56.555131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] PATH_INFO: `/v3/projects/51955e3298394dfc805894c208a6a8ea` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:56.559544 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=51955e3298394dfc805894c208a6a8ea)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:56.561567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:56.662971 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51955e3298394dfc805894c208a6a8ea', 'request_id': 'req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.674181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51955e3298394dfc805894c208a6a8ea', 'request_id': 'req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.689036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51955e3298394dfc805894c208a6a8ea', 'request_id': 'req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.703403 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] The token cache is being invalidate because project 51955e3298394dfc805894c208a6a8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:56.703891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.704738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.706462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1355/2696] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:56 2022] DELETE /identity/v3/projects/51955e3298394dfc805894c208a6a8ea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:56.710661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:56.723290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f5828-3993-45dc-884a-42a10b862e7c service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:56.818197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:56.820782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:56.821819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:56.822215 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] PATH_INFO: `/v3/users/b91fc5f0f69540ab9c7ca4e9772f932c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:56.824154 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91fc5f0f69540ab9c7ca4e9772f932c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:56.828478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:56.911121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91fc5f0f69540ab9c7ca4e9772f932c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.920849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91fc5f0f69540ab9c7ca4e9772f932c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.921918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91fc5f0f69540ab9c7ca4e9772f932c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.922947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91fc5f0f69540ab9c7ca4e9772f932c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.937531 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7970324d-cd7d-4373-b103-61b8547c9b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91fc5f0f69540ab9c7ca4e9772f932c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:56.983276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1342/2697] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:56 2022] DELETE /identity/v3/users/b91fc5f0f69540ab9c7ca4e9772f932c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:57.551603 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:57.553804 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:57.575093 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ef7a7-11e6-4ad4-8f36-e35f8b2c69ea admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:57.669289 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:57.671122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:57.671639 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:57.672205 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] PATH_INFO: `/v3/projects/4f2f74cc3b6a494e80fa38e2e17c7032` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:57.674582 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2f74cc3b6a494e80fa38e2e17c7032)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:57.676861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:57.743917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2f74cc3b6a494e80fa38e2e17c7032', 'request_id': 'req-19b42200-15cd-471d-b214-2cc86875520d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:57.754566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2f74cc3b6a494e80fa38e2e17c7032', 'request_id': 'req-19b42200-15cd-471d-b214-2cc86875520d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:57.764353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2f74cc3b6a494e80fa38e2e17c7032', 'request_id': 'req-19b42200-15cd-471d-b214-2cc86875520d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:57.782939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] The token cache is being invalidate because project 4f2f74cc3b6a494e80fa38e2e17c7032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:13:57.783680 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:57.784567 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-19b42200-15cd-471d-b214-2cc86875520d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:57.787386 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1356/2698] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:13:57 2022] DELETE /identity/v3/projects/4f2f74cc3b6a494e80fa38e2e17c7032 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:57.792704 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5e371-da32-4d05-b071-11306e95a134 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:57.793761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5e371-da32-4d05-b071-11306e95a134 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:57.794254 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5e371-da32-4d05-b071-11306e95a134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:57.820940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4fb5e371-da32-4d05-b071-11306e95a134 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:57.824652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4fb5e371-da32-4d05-b071-11306e95a134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:57.911654 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1343/2699] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:57.919946 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b11c-1ce8-45e5-92dd-8b4370e38cb9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:57.920605 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b11c-1ce8-45e5-92dd-8b4370e38cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:57.921095 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b11c-1ce8-45e5-92dd-8b4370e38cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:57.949556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2423b11c-1ce8-45e5-92dd-8b4370e38cb9 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:57.951086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2423b11c-1ce8-45e5-92dd-8b4370e38cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:57.960592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1357/2700] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:57.965610 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5e371-da32-4d05-b071-11306e95a134 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:57.982987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5e371-da32-4d05-b071-11306e95a134 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:57.995209 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:57.996027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:57.996440 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:57.996934 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:57.998267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:13:57.998831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.001635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:58.020397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1344/2701] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:13:58.024413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b11c-1ce8-45e5-92dd-8b4370e38cb9 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:58.034833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b11c-1ce8-45e5-92dd-8b4370e38cb9 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:58.042845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:58.046006 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.046462 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.046897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.047812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.050425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:58.101171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1358/2702] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:58 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:58.102400 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:58.114669 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c19f34-c994-412e-9340-79b256c4ff1a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:58.207981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:58.208676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.209009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.209284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.210031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.212305 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:58.244813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1345/2703] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:58 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:13:58.248795 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:58.263463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a3c6-963f-4a87-8a15-9810830c35a0 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:58.268982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:58.269713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.269994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.270278 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.271148 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.272773 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:58.291096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1359/2704] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:58.295029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:58.307827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b2eed-790b-4069-83ed-86da7940130a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:58.314220 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0993c0e-aad2-478f-a777-697bc6a56814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:58.315059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993c0e-aad2-478f-a777-697bc6a56814 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.315434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993c0e-aad2-478f-a777-697bc6a56814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.315783 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993c0e-aad2-478f-a777-697bc6a56814 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.316595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0993c0e-aad2-478f-a777-697bc6a56814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.318352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0993c0e-aad2-478f-a777-697bc6a56814 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:58.332882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1346/2705] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:13:58.337589 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:58.348270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621bc5-038c-439b-8940-4d18b06ca5c8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:58.355314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:58.357135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.357986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.358487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] PATH_INFO: `/v3/projects/733055ae29224f42af5ecef3675f7e9a/users/0b334fca31d84ad881a4a71a28b1f038/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.380453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733055ae29224f42af5ecef3675f7e9a, user_id=0b334fca31d84ad881a4a71a28b1f038, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.384413 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:58.427458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1360/2706] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:58 2022] PUT /identity/v3/projects/733055ae29224f42af5ecef3675f7e9a/users/0b334fca31d84ad881a4a71a28b1f038/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:58.443327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc89d0-ffdd-4a60-9fe1-c19c0e9cb327 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.445295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc89d0-ffdd-4a60-9fe1-c19c0e9cb327 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.445667 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc89d0-ffdd-4a60-9fe1-c19c0e9cb327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.504545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-73dc89d0-ffdd-4a60-9fe1-c19c0e9cb327 None None] MFA Rules not processed for user `0b334fca31d84ad881a4a71a28b1f038`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:58.505947 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-73dc89d0-ffdd-4a60-9fe1-c19c0e9cb327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:58.611195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1347/2707] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:58.628074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:58.631182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:58.753981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0abb-b0a3-4e20-8c66-cc6778cedb61 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:58.757583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50aab2-4456-4b04-9dd2-76cd71ec77f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:58.758268 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50aab2-4456-4b04-9dd2-76cd71ec77f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.758587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50aab2-4456-4b04-9dd2-76cd71ec77f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.758865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50aab2-4456-4b04-9dd2-76cd71ec77f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.787803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50aab2-4456-4b04-9dd2-76cd71ec77f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.791990 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50aab2-4456-4b04-9dd2-76cd71ec77f0 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:58.809670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1361/2708] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:58.842084 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc89d0-ffdd-4a60-9fe1-c19c0e9cb327 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:58.947702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc89d0-ffdd-4a60-9fe1-c19c0e9cb327 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:58.952986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:58.954853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:58.955303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:58.955735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] PATH_INFO: `/v3/users/0b334fca31d84ad881a4a71a28b1f038` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:58.957779 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b334fca31d84ad881a4a71a28b1f038)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:58.960113 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:59.035933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b334fca31d84ad881a4a71a28b1f038'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:59.058805 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b334fca31d84ad881a4a71a28b1f038'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:59.059769 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b334fca31d84ad881a4a71a28b1f038'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:59.060137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b334fca31d84ad881a4a71a28b1f038'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:59.064951 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:59.066021 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:59.066318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:59.075052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-739a0633-6b9b-432f-b6e8-17084bf48cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b334fca31d84ad881a4a71a28b1f038'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:13:59.119773 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1348/2709] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:13:58 2022] DELETE /identity/v3/users/0b334fca31d84ad881a4a71a28b1f038 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:13:59.122332 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:59.122797 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:59.125304 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:59.131545 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] MFA Rules not processed for user `0e0b0f5728f244578741648259bbcd59`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:59.134616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:59.147318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:13:59.148754 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:59.344323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1349/2710] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:59.354932 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1362/2711] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:13:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:13:59.355656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:59.359346 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:59.392417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022848e-7be2-4d44-8890-9e45068089bc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:59.398269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:59.399719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:59.400198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:59.400479 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:59.401178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:59.403230 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:59.423577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:59.425814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:13:59.474995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1350/2712] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:13:59 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:59.479565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:59.565030 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738510f0-abaf-4214-ae88-32d047dd76bc None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:59.610548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f658b2b-3191-4312-82ea-ce746e63c31c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:59.617631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:59.619111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:59.619503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:59.619879 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:59.621178 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:59.627868 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:59.675294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1351/2713] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:13:59 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:13:59.679017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:59.693450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7327a9-f17c-41c6-b606-b49643e4bf3b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:59.702049 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:59.703568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:59.704171 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:59.705038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:59.705503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:59.706260 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:59.706628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:59.706972 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:59.707774 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:59.711278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:59.733132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1352/2714] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:13:59.738214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:59.738732 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:59.742089 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:59.759375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4dfc9-51aa-4c69-9560-ce75123b845e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:13:59.765693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1363/2715] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:13:59.780443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:13:59.781448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:13:59.781845 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:13:59.782197 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] PATH_INFO: `/v3/projects/0756fee562b84347967bbed713442101/users/2b703924efe74780a8293d58d684ea84/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:13:59.813547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0756fee562b84347967bbed713442101, user_id=2b703924efe74780a8293d58d684ea84, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:13:59.816873 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:13:59.861911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1353/2716] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:13:59 2022] PUT /identity/v3/projects/0756fee562b84347967bbed713442101/users/2b703924efe74780a8293d58d684ea84/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:13:59.866481 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:13:59.894248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5792be4-fe13-469e-9143-3378ab9a48dc service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:00.042377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:00.043058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:00.043400 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:00.043602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:00.044486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:00.047019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:00.072587 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1364/2717] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:00.076538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:00.094273 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f62257-2f6b-44b1-931b-5b378ac20b05 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:00.103424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995faa2-5e5f-475e-b391-1e1c189d92d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:00.110184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995faa2-5e5f-475e-b391-1e1c189d92d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:00.113116 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995faa2-5e5f-475e-b391-1e1c189d92d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:00.113764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995faa2-5e5f-475e-b391-1e1c189d92d6 admin admin] PATH_INFO: `/v3/projects/0756fee562b84347967bbed713442101/users/2b703924efe74780a8293d58d684ea84/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:00.119027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995faa2-5e5f-475e-b391-1e1c189d92d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0756fee562b84347967bbed713442101, user_id=2b703924efe74780a8293d58d684ea84, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:00.123357 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995faa2-5e5f-475e-b391-1e1c189d92d6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:00.151165 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1354/2718] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:00 2022] PUT /identity/v3/projects/0756fee562b84347967bbed713442101/users/2b703924efe74780a8293d58d684ea84/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:00.366326 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:00.368372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:00.438884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ffdb-94fd-4796-b809-74bd16f9ddac admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:00.585769 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:00.586854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:00.587152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:00.587428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] PATH_INFO: `/v3/projects/733055ae29224f42af5ecef3675f7e9a` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:00.588934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733055ae29224f42af5ecef3675f7e9a)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:00.593416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:00.669716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733055ae29224f42af5ecef3675f7e9a', 'request_id': 'req-a51959bc-e7fd-411f-8be2-7d74446a6404'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:00.684600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733055ae29224f42af5ecef3675f7e9a', 'request_id': 'req-a51959bc-e7fd-411f-8be2-7d74446a6404'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:00.706105 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733055ae29224f42af5ecef3675f7e9a', 'request_id': 'req-a51959bc-e7fd-411f-8be2-7d74446a6404'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:00.732449 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] The token cache is being invalidate because project 733055ae29224f42af5ecef3675f7e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:00.732738 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:00.733415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a51959bc-e7fd-411f-8be2-7d74446a6404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:00.738190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1365/2719] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:00 2022] DELETE /identity/v3/projects/733055ae29224f42af5ecef3675f7e9a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:00.740595 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83971c7-5ac2-4775-82c7-1106affd809b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:00.740952 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83971c7-5ac2-4775-82c7-1106affd809b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:00.741290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83971c7-5ac2-4775-82c7-1106affd809b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:00.767887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c83971c7-5ac2-4775-82c7-1106affd809b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:00.769204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c83971c7-5ac2-4775-82c7-1106affd809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:00.864395 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1355/2720] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:00.872371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e118-061c-4f4f-87b7-22db40235e73 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:00.872725 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e118-061c-4f4f-87b7-22db40235e73 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:00.873094 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e118-061c-4f4f-87b7-22db40235e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:00.907439 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-4f63e118-061c-4f4f-87b7-22db40235e73 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:00.908825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4f63e118-061c-4f4f-87b7-22db40235e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:00.921713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1366/2721] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:00.925716 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83971c7-5ac2-4775-82c7-1106affd809b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:00.936421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83971c7-5ac2-4775-82c7-1106affd809b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:00.954170 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:00.955051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:00.955397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:00.955910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:00.956854 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:14:00.957800 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:00.959619 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:00.987710 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1356/2722] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:14:00.992406 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e118-061c-4f4f-87b7-22db40235e73 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:01.008140 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e118-061c-4f4f-87b7-22db40235e73 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:01.020698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:01.021641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:01.023897 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:01.024886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:01.026517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:01.030803 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:01.097399 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1367/2723] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:14:00 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:01.101457 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:01.112921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803b43-aa4c-4bae-895c-d56f677ab8b6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:01.220759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:01.221450 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:01.221759 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:01.222032 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:01.222722 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:01.224677 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:01.275730 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1357/2724] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:14:01 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:01.281814 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:01.300797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce0622-64c4-48d8-8c9a-6f584cf39331 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:01.314785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:01.315483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:01.315889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:01.316173 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:01.316861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:01.318825 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:01.338257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1368/2725] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:01.342559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:01.362684 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15083b3a-0b28-4556-9af7-7b9a622009bb admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:01.375656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff7fbe-f59e-40fd-b15e-0724b718daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:01.376515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7fbe-f59e-40fd-b15e-0724b718daf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:01.378493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7fbe-f59e-40fd-b15e-0724b718daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:01.378801 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7fbe-f59e-40fd-b15e-0724b718daf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:01.379578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff7fbe-f59e-40fd-b15e-0724b718daf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:01.387471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff7fbe-f59e-40fd-b15e-0724b718daf1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:01.415886 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:01.418858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1358/2726] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:01.434451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d0326-4c5c-4ce8-b121-2df63cd8a2eb admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:01.452737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:01.453987 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:01.454429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:01.454862 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] PATH_INFO: `/v3/projects/48a64e3dbed14874b9bdd01504a4dcaa/users/25b17f78ffb4476c83e8481891b65fcb/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:01.483230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a64e3dbed14874b9bdd01504a4dcaa, user_id=25b17f78ffb4476c83e8481891b65fcb, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:01.488077 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:01.517649 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1369/2727] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:01 2022] PUT /identity/v3/projects/48a64e3dbed14874b9bdd01504a4dcaa/users/25b17f78ffb4476c83e8481891b65fcb/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:14:01.530714 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36028fef-1bc5-495d-8db3-6a3a135db074 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:01.531221 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36028fef-1bc5-495d-8db3-6a3a135db074 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:01.531666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36028fef-1bc5-495d-8db3-6a3a135db074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:01.621288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-36028fef-1bc5-495d-8db3-6a3a135db074 None None] MFA Rules not processed for user `25b17f78ffb4476c83e8481891b65fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:01.622958 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-36028fef-1bc5-495d-8db3-6a3a135db074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:01.755688 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1359/2728] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:01.761685 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:01.889554 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944b79c-7fca-4842-a778-88053575cd04 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:01.897801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:01.898704 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:01.899679 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:01.900112 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:01.901003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:01.903396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:01.948062 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1370/2729] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:14:01 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:14:01.952954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36028fef-1bc5-495d-8db3-6a3a135db074 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:01.972421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36028fef-1bc5-495d-8db3-6a3a135db074 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:02.123791 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:02.125345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:02.125882 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:02.126341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:02.127283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:02.130046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:02.172602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1360/2730] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:14:01 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:02.177220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:02.198925 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f57c-19b8-407e-91f7-613c2312802e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:02.207452 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:02.208198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:02.208486 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:02.208763 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:02.209677 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:02.212717 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:02.233483 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1371/2731] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:02.233628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:02.258158 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4addad4-95fe-4b51-a23b-d7ba6996c0f4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:02.272517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:02.273434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:02.273741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:02.274074 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] PATH_INFO: `/v3/projects/d861997748c84282b5845cbba46d1e07/users/9e5c5a8df5464dfa8082901348dea2c2/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:02.315100 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d861997748c84282b5845cbba46d1e07, user_id=9e5c5a8df5464dfa8082901348dea2c2, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:02.317925 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:02.341102 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1361/2732] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:02 2022] PUT /identity/v3/projects/d861997748c84282b5845cbba46d1e07/users/9e5c5a8df5464dfa8082901348dea2c2/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:02.344927 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:02.365434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ae9e-4578-400e-be08-8869b8793949 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:02.483623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f34e7-9e7f-48c6-bd51-e7d06b716670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:02.484281 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f34e7-9e7f-48c6-bd51-e7d06b716670 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:02.485002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f34e7-9e7f-48c6-bd51-e7d06b716670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:02.485002 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f34e7-9e7f-48c6-bd51-e7d06b716670 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:02.485781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f34e7-9e7f-48c6-bd51-e7d06b716670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:02.487471 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f34e7-9e7f-48c6-bd51-e7d06b716670 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:02.508160 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1372/2733] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:02.509416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:02.524533 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd00b-33fa-4bdb-be48-2b73e97ddfb0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:02.536701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:02.538111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:02.538583 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:02.539066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] PATH_INFO: `/v3/projects/d861997748c84282b5845cbba46d1e07/users/9e5c5a8df5464dfa8082901348dea2c2/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:02.549491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d861997748c84282b5845cbba46d1e07, user_id=9e5c5a8df5464dfa8082901348dea2c2, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:02.552444 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:02.593586 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1362/2734] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:02 2022] PUT /identity/v3/projects/d861997748c84282b5845cbba46d1e07/users/9e5c5a8df5464dfa8082901348dea2c2/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:02.598058 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a9e81-5ef9-4e6b-9b1b-c775fea3c349 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:02.598337 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a9e81-5ef9-4e6b-9b1b-c775fea3c349 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:02.598658 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a9e81-5ef9-4e6b-9b1b-c775fea3c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:02.640026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6a7a9e81-5ef9-4e6b-9b1b-c775fea3c349 None None] MFA Rules not processed for user `9e5c5a8df5464dfa8082901348dea2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:02.642270 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6a7a9e81-5ef9-4e6b-9b1b-c775fea3c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:02.752739 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1373/2735] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:02.761635 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:02.763525 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:02.882150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6987b-a9e3-4b93-9bf6-7057afaad58f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:02.888119 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:02.889027 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:02.889505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:02.889940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:03.072652 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:03.081748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:03.107792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1363/2736] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:04.760664 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9592189-95f1-4310-b58f-ecf53f4d805f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:04.761134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9592189-95f1-4310-b58f-ecf53f4d805f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:04.761260 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9592189-95f1-4310-b58f-ecf53f4d805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:04.902098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-e9592189-95f1-4310-b58f-ecf53f4d805f None None] MFA Rules not processed for user `1fa0cd8ed723418daf1cbd6933e0ce6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:04.911889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-e9592189-95f1-4310-b58f-ecf53f4d805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:05.157991 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1374/2737] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:05.162270 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:05.165439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:05.432563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514b7d2-0e4c-4621-ad20-5d1e1391493f service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:05.453232 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:05.454434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:05.454434 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:05.454631 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:05.455257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:05.457386 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:05.519790 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9592189-95f1-4310-b58f-ecf53f4d805f None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:05.521751 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1364/2738] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:14:05 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:05.537359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9592189-95f1-4310-b58f-ecf53f4d805f None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:05.686343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:05.687050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:05.687320 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:05.687588 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:05.688470 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:05.690949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:05.746802 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1375/2739] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:14:05 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:05.751496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:05.766621 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b2f7-ee3b-45b4-83bd-ed275e2240da admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:05.792065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:05.792979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:05.796913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:05.800263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:05.803700 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:05.807059 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:05.829159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1365/2740] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:14:05.834500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:05.850766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0bc8-5704-4f76-b07a-577346169d8a admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:05.858251 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:05.872458 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:05.874889 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:05.875175 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] PATH_INFO: `/v3/projects/744b0f3356ab47b08317213c0f3055ba/users/6e2938ee96d0473c99e7bb8252389329/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:05.922321 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744b0f3356ab47b08317213c0f3055ba, user_id=6e2938ee96d0473c99e7bb8252389329, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:05.938033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:05.986074 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1376/2741] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:05 2022] PUT /identity/v3/projects/744b0f3356ab47b08317213c0f3055ba/users/6e2938ee96d0473c99e7bb8252389329/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:05.990433 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:06.072913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4615c-ade6-4201-ac2b-654767a15443 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:06.272914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:06.273819 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:06.274200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:06.274571 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:06.275411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:06.279701 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:06.310881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1366/2742] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:06.315697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:06.328941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd231b-cb3b-4362-aa28-7ddc8d6b96d4 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:06.350519 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9d2f7-673d-444d-ba0c-6a29df7965eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:06.351434 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9d2f7-673d-444d-ba0c-6a29df7965eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:06.351713 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9d2f7-673d-444d-ba0c-6a29df7965eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:06.352025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9d2f7-673d-444d-ba0c-6a29df7965eb admin admin] PATH_INFO: `/v3/projects/744b0f3356ab47b08317213c0f3055ba/users/6e2938ee96d0473c99e7bb8252389329/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:06.358955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9d2f7-673d-444d-ba0c-6a29df7965eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=744b0f3356ab47b08317213c0f3055ba, user_id=6e2938ee96d0473c99e7bb8252389329, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:06.361748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9d2f7-673d-444d-ba0c-6a29df7965eb admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:06.397298 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1377/2743] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:06 2022] PUT /identity/v3/projects/744b0f3356ab47b08317213c0f3055ba/users/6e2938ee96d0473c99e7bb8252389329/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:06.419475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:06.432920 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323783-b96f-4a2c-9cd4-946435a1be15 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:06.597892 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:06.602609 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:06.603012 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:06.603290 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] PATH_INFO: `/v3/users/25b17f78ffb4476c83e8481891b65fcb` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:06.611217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b17f78ffb4476c83e8481891b65fcb)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:06.615776 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:06.768509 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b17f78ffb4476c83e8481891b65fcb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:06.785600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b17f78ffb4476c83e8481891b65fcb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:06.786537 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b17f78ffb4476c83e8481891b65fcb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:06.789210 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b17f78ffb4476c83e8481891b65fcb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:06.808705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b17f78ffb4476c83e8481891b65fcb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:06.850367 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1367/2744] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:14:06 2022] DELETE /identity/v3/users/25b17f78ffb4476c83e8481891b65fcb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:06.851580 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22080c85-d141-4730-9524-0674fbc79049 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:06.852628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22080c85-d141-4730-9524-0674fbc79049 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:06.852749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22080c85-d141-4730-9524-0674fbc79049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:06.908928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-22080c85-d141-4730-9524-0674fbc79049 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:06.910949 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-22080c85-d141-4730-9524-0674fbc79049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:07.105672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1378/2745] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:07.118464 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:07.120034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:07.234000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ccedc-d0e2-4b74-8054-0ad6a0ffd81f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:07.239152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:07.242825 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:07.243461 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:07.243944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:07.257702 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:07.261996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:07.276009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1368/2746] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:08.611198 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22080c85-d141-4730-9524-0674fbc79049 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:08.612787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-22080c85-d141-4730-9524-0674fbc79049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:08.629777 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22080c85-d141-4730-9524-0674fbc79049 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:08.649919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:08.650954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:08.651336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:08.651698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] PATH_INFO: `/v3/projects/48a64e3dbed14874b9bdd01504a4dcaa` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:08.653065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a64e3dbed14874b9bdd01504a4dcaa)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:08.655269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:08.761865 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a64e3dbed14874b9bdd01504a4dcaa', 'request_id': 'req-93e13986-a4e8-4dd0-b55d-570634c397cb'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:08.778801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a64e3dbed14874b9bdd01504a4dcaa', 'request_id': 'req-93e13986-a4e8-4dd0-b55d-570634c397cb'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:08.795376 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a64e3dbed14874b9bdd01504a4dcaa', 'request_id': 'req-93e13986-a4e8-4dd0-b55d-570634c397cb'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:08.808792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] The token cache is being invalidate because project 48a64e3dbed14874b9bdd01504a4dcaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:08.809278 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:08.811149 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-93e13986-a4e8-4dd0-b55d-570634c397cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:08.813388 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1379/2747] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:08 2022] DELETE /identity/v3/projects/48a64e3dbed14874b9bdd01504a4dcaa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:08.817287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:08.828402 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcfbf6-a7d4-45b7-9124-327ccc30d5e5 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:08.929214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:08.930798 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:08.931081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:08.931411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] PATH_INFO: `/v3/users/9e5c5a8df5464dfa8082901348dea2c2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:08.934140 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5c5a8df5464dfa8082901348dea2c2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:08.937127 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:09.045720 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5c5a8df5464dfa8082901348dea2c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:09.059208 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5c5a8df5464dfa8082901348dea2c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:09.060150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5c5a8df5464dfa8082901348dea2c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:09.060915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5c5a8df5464dfa8082901348dea2c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:09.081637 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5c5a8df5464dfa8082901348dea2c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:09.121121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1369/2748] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:14:08 2022] DELETE /identity/v3/users/9e5c5a8df5464dfa8082901348dea2c2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:14:09.998036 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:09.998916 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:09.999342 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:10.033884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] MFA Rules not processed for user `2b703924efe74780a8293d58d684ea84`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:10.035558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:10.133791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1380/2749] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:10.144137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:10.145624 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:10.323368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7e11c-4fe9-40a7-89ac-82ead418b648 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:10.327676 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19cceb-c7d0-44ce-ba6c-8464a17b0855 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9c380955a04c24af2823e22fe3ec70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:10.328590 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19cceb-c7d0-44ce-ba6c-8464a17b0855 service glance] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:10.329029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19cceb-c7d0-44ce-ba6c-8464a17b0855 service glance] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:10.329456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19cceb-c7d0-44ce-ba6c-8464a17b0855 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:10.331519 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b19cceb-c7d0-44ce-ba6c-8464a17b0855 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:10.424741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19cceb-c7d0-44ce-ba6c-8464a17b0855 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:10.426553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19cceb-c7d0-44ce-ba6c-8464a17b0855 service glance] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:10.438693 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1370/2750] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:10.513367 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:10.518489 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:10.641312 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb617747-78bc-435a-87ab-2f8501b40901 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:10.647719 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc9f3-6391-4f68-bf21-0e9c3e30c192 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:10.648194 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc9f3-6391-4f68-bf21-0e9c3e30c192 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:10.648981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc9f3-6391-4f68-bf21-0e9c3e30c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:10.651447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:10.657353 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:10.661583 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:10.662581 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] PATH_INFO: `/v3/projects/d861997748c84282b5845cbba46d1e07` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:10.665314 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d861997748c84282b5845cbba46d1e07)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:10.668129 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0ebbc9f3-6391-4f68-bf21-0e9c3e30c192 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:10.668956 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:10.670024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0ebbc9f3-6391-4f68-bf21-0e9c3e30c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:10.752501 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1371/2751] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:14:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:14:10.766723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd861997748c84282b5845cbba46d1e07', 'request_id': 'req-dcadb3c6-755f-4a8a-95db-f516a65b51a7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:10.783654 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd861997748c84282b5845cbba46d1e07', 'request_id': 'req-dcadb3c6-755f-4a8a-95db-f516a65b51a7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:10.796909 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd861997748c84282b5845cbba46d1e07', 'request_id': 'req-dcadb3c6-755f-4a8a-95db-f516a65b51a7'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:10.811785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] The token cache is being invalidate because project d861997748c84282b5845cbba46d1e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:10.812150 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:10.812899 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:10.815259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1381/2752] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:10 2022] DELETE /identity/v3/projects/d861997748c84282b5845cbba46d1e07 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:10.820120 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2026b-a253-4dc5-948b-2a0050f75097 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:10.820574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2026b-a253-4dc5-948b-2a0050f75097 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:10.821408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2026b-a253-4dc5-948b-2a0050f75097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:10.841075 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:10.843551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:10.848163 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fbd2026b-a253-4dc5-948b-2a0050f75097 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:10.849695 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fbd2026b-a253-4dc5-948b-2a0050f75097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:10.969617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1372/2753] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:10.976389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377867e-01b7-4182-b0fd-421b8e1e7db8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:10.978574 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377867e-01b7-4182-b0fd-421b8e1e7db8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:10.979060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377867e-01b7-4182-b0fd-421b8e1e7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:10.980801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb3c6-755f-4a8a-95db-f516a65b51a7 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:11.000914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:11.002552 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.002947 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.005820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.011570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:11.029858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8377867e-01b7-4182-b0fd-421b8e1e7db8 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:11.031373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8377867e-01b7-4182-b0fd-421b8e1e7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:11.052015 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1373/2754] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:11.053636 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377867e-01b7-4182-b0fd-421b8e1e7db8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:11.066795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377867e-01b7-4182-b0fd-421b8e1e7db8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:11.073017 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:11.074247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.074764 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.075387 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.076511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:14:11.077061 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:11.079136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:11.109835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1374/2755] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:14:11.114385 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:11.136979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d8a46-56b3-4fc6-9f1b-bbffa26097d7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:11.147344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:11.150473 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.154010 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.154568 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.155679 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:11.159670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:11.180716 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:11.186787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:11.197941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1382/2756] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 19:14:11.222094 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1375/2757] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:14:11 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:11.234837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:11.253786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb767b1-2d0c-475d-aa6a-b7fd37f87167 service swift] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:11.393594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:11.395854 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.397661 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.398162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.400031 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:11.403533 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:11.462866 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1383/2758] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:14:11 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:11.463430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:11.477066 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57207f5a-a5c2-4b2e-a040-6cb0dd207e9c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:11.489111 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:11.490109 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.490603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.491067 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.491986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:11.496345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:11.528160 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1376/2759] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:14:11.532202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:11.547436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf86b8-6b36-4ff5-9198-ca6758bddc2e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:11.558659 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b5705-ed19-4910-814e-c87e207e2adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:11.559361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5705-ed19-4910-814e-c87e207e2adf admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.559726 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5705-ed19-4910-814e-c87e207e2adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.560013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5705-ed19-4910-814e-c87e207e2adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.560745 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5705-ed19-4910-814e-c87e207e2adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:11.571162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5705-ed19-4910-814e-c87e207e2adf admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:11.586941 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1384/2760] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:14:11.590795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:11.603599 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a59a8c-e4eb-4a7d-98ce-bfcc95b8c028 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:11.613545 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:11.614548 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.614830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.615110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] PATH_INFO: `/v3/projects/3c331adb2d6541efbab26b5e11c096be/users/2fbc2486d3ef49b79d8422f25b6d0257/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.652390 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c331adb2d6541efbab26b5e11c096be, user_id=2fbc2486d3ef49b79d8422f25b6d0257, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:11.657816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:11.689336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1377/2761] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:11 2022] PUT /identity/v3/projects/3c331adb2d6541efbab26b5e11c096be/users/2fbc2486d3ef49b79d8422f25b6d0257/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:11.701423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:11.701737 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:11.702018 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:11.759050 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] MFA Rules not processed for user `2fbc2486d3ef49b79d8422f25b6d0257`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:11.760372 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:11.880712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1385/2762] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:11.894547 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:11.896424 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:12.078789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2577e-b728-40c8-8552-3b62d1dac1cb admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:12.101643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a867cf-25ca-42de-a3e6-20fb852737de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:12.102986 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a867cf-25ca-42de-a3e6-20fb852737de service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:12.103271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a867cf-25ca-42de-a3e6-20fb852737de service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:12.103553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a867cf-25ca-42de-a3e6-20fb852737de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:12.121409 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a867cf-25ca-42de-a3e6-20fb852737de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:12.123166 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a867cf-25ca-42de-a3e6-20fb852737de service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:12.151906 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1378/2763] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:13.659016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:13.660474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:13.932775 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616de1cd-6dde-43f0-a7de-75b72e3903b7 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:13.953711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:13.957333 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:13.960230 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:13.963748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] PATH_INFO: `/v3/users/41f8ecec23254a529ea4df51fd568f97` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:13.968629 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f8ecec23254a529ea4df51fd568f97)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:13.986959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:14.058964 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687487-e3f0-4186-8fe7-f1bad2b16110 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:14.060052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687487-e3f0-4186-8fe7-f1bad2b16110 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:14.060500 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687487-e3f0-4186-8fe7-f1bad2b16110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:14.090591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-09687487-e3f0-4186-8fe7-f1bad2b16110 None None] MFA Rules not processed for user `2fbc2486d3ef49b79d8422f25b6d0257`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:14.092095 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-09687487-e3f0-4186-8fe7-f1bad2b16110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:14.104073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1379/2764] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:14:14.193220 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f8ecec23254a529ea4df51fd568f97'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:14.245042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f8ecec23254a529ea4df51fd568f97'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:14.246219 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f8ecec23254a529ea4df51fd568f97'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:14.273799 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f8ecec23254a529ea4df51fd568f97'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:14.275851 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f8ecec23254a529ea4df51fd568f97'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:14.349820 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1386/2765] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:14:13 2022] DELETE /identity/v3/users/41f8ecec23254a529ea4df51fd568f97 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:14.355497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:14.356478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:14.356909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:14.414921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:14.421540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:14.632193 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1380/2766] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:14.784744 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:14.786239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:14.933368 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca07528-4297-4593-a755-13399ccb0c83 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:14.943864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:14.945170 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:14.946102 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:14.947869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:14.972723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:14.974861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:15.002673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1387/2767] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:16.041742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:16.043711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:16.065212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1c2be-ac47-4e83-93de-9027ec600af4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:16.094364 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:16.096168 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:16.096687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:16.097144 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] PATH_INFO: `/v3/projects/53ba3beed39a4af9b7fbf4cbcf106c5a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:16.112099 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ba3beed39a4af9b7fbf4cbcf106c5a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:16.114628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:16.246487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ba3beed39a4af9b7fbf4cbcf106c5a', 'request_id': 'req-d5c81d42-6abd-4e54-8c21-e089ac245a1e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.285216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ba3beed39a4af9b7fbf4cbcf106c5a', 'request_id': 'req-d5c81d42-6abd-4e54-8c21-e089ac245a1e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.310741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ba3beed39a4af9b7fbf4cbcf106c5a', 'request_id': 'req-d5c81d42-6abd-4e54-8c21-e089ac245a1e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.358117 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] The token cache is being invalidate because project 53ba3beed39a4af9b7fbf4cbcf106c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:16.358416 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.371137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.374018 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1381/2768] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:16 2022] DELETE /identity/v3/projects/53ba3beed39a4af9b7fbf4cbcf106c5a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:14:16.378135 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:16.392524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2132-103c-4740-9d8f-b7c220356ed5 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:16.653201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:16.658125 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:16.660813 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:16.663425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] PATH_INFO: `/v3/users/eef1061a882845059143537424ef0c78` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:16.666811 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef1061a882845059143537424ef0c78)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:16.685958 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:16.791273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef1061a882845059143537424ef0c78'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.804977 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef1061a882845059143537424ef0c78'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.806697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef1061a882845059143537424ef0c78'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.824553 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef1061a882845059143537424ef0c78'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.825513 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-a52c66a8-9606-434b-8131-ee6eef289aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef1061a882845059143537424ef0c78'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:16.859566 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1388/2769] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:14:16 2022] DELETE /identity/v3/users/eef1061a882845059143537424ef0c78 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:17.535698 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:17.537198 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:17.549035 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:17.549614 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:17.549747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:17.555625 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c81d42-6abd-4e54-8c21-e089ac245a1e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:17.621928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] MFA Rules not processed for user `6e2938ee96d0473c99e7bb8252389329`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:17.621928 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:17.701744 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:17.702626 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:17.702903 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:17.703175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] PATH_INFO: `/v3/projects/59768fba9c114e3f87d3bdc73f29f873` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:17.707931 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=59768fba9c114e3f87d3bdc73f29f873)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:17.710705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:17.812670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1389/2770] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:17.821224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59768fba9c114e3f87d3bdc73f29f873', 'request_id': 'req-3142ca23-06ec-42da-b6db-93825ff21e3d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:17.825786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:17.827465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:17.832341 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59768fba9c114e3f87d3bdc73f29f873', 'request_id': 'req-3142ca23-06ec-42da-b6db-93825ff21e3d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:17.852816 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59768fba9c114e3f87d3bdc73f29f873', 'request_id': 'req-3142ca23-06ec-42da-b6db-93825ff21e3d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:17.871859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] The token cache is being invalidate because project 59768fba9c114e3f87d3bdc73f29f873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:17.871859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:17.877909 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3142ca23-06ec-42da-b6db-93825ff21e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:17.884052 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1382/2771] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:17 2022] DELETE /identity/v3/projects/59768fba9c114e3f87d3bdc73f29f873 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:17.885927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225304ab-6232-4609-b905-3b6eea5e64f7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:17.886517 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225304ab-6232-4609-b905-3b6eea5e64f7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:17.887128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225304ab-6232-4609-b905-3b6eea5e64f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:17.914666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-225304ab-6232-4609-b905-3b6eea5e64f7 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:17.916389 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-225304ab-6232-4609-b905-3b6eea5e64f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:17.934141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ec39-5fa6-4381-8807-46a9396e815d None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.004670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1383/2772] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:18.006482 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b0bc-8c06-4957-b177-e9af49aa9c10 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.006938 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b0bc-8c06-4957-b177-e9af49aa9c10 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.007401 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b0bc-8c06-4957-b177-e9af49aa9c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.018919 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.019762 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.020792 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.022500 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.030443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:18.055965 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fad1b0bc-8c06-4957-b177-e9af49aa9c10 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:18.057569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fad1b0bc-8c06-4957-b177-e9af49aa9c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:18.069878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1384/2773] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:18.071265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b0bc-8c06-4957-b177-e9af49aa9c10 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:18.081497 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b0bc-8c06-4957-b177-e9af49aa9c10 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.087622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.088597 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.089031 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.089505 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.090594 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:14:18.091073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.092889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:18.107563 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1385/2774] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:14:18.112345 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:18.127439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5c2d-00ca-4ad5-ab1a-8fa371376145 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.133026 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.134097 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.135738 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.136353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.137149 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.144343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:18.188295 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.193262 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:18.199930 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1386/2775] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:14:18 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:18.204288 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:18.220259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1390/2776] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:18.322508 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1f54-98ca-4c7e-a4ec-36eb4343b125 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.329233 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.331191 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.331672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.332421 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.333320 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.335476 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:18.377247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1387/2777] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:14:18 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:14:18.382815 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:18.400666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f81533-d1d1-4490-9605-e2f3b9c2dcd6 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.439026 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.439789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.442257 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.442601 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.443345 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.444966 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:18.456256 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1391/2778] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:18.460132 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:18.472951 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448227f-26aa-4078-80ec-a095976a2be5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.481742 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53be316-d9e6-4e48-bfdd-86af99d81660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.483570 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be316-d9e6-4e48-bfdd-86af99d81660 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.484081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be316-d9e6-4e48-bfdd-86af99d81660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.484576 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be316-d9e6-4e48-bfdd-86af99d81660 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.485555 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53be316-d9e6-4e48-bfdd-86af99d81660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.488078 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53be316-d9e6-4e48-bfdd-86af99d81660 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:18.503161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1388/2779] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:18.503563 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:18.514978 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1af4-7f17-4548-8542-c08d9786281b admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.527401 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.528749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.529273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.533542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] PATH_INFO: `/v3/projects/9e329123ae6c447bb2ace12c8883bfe6/users/411b0f6b2278430f9cacffd8e06546ba/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.555651 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e329123ae6c447bb2ace12c8883bfe6, user_id=411b0f6b2278430f9cacffd8e06546ba, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.564390 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:18.593485 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1392/2780] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:18 2022] PUT /identity/v3/projects/9e329123ae6c447bb2ace12c8883bfe6/users/411b0f6b2278430f9cacffd8e06546ba/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:18.604122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60856a-8b8c-4028-bc4e-377d51235800 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.604670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60856a-8b8c-4028-bc4e-377d51235800 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.604670 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60856a-8b8c-4028-bc4e-377d51235800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.657538 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bc60856a-8b8c-4028-bc4e-377d51235800 None None] MFA Rules not processed for user `411b0f6b2278430f9cacffd8e06546ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:18.661236 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bc60856a-8b8c-4028-bc4e-377d51235800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:18.809562 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1389/2781] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:18.810701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:18.939360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73173a69-1a4f-4dc9-8a74-038071fd3082 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:18.954636 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:18.955322 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:18.955607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:18.955882 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:18.956574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:18.958592 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:19.016641 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1393/2782] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:14:18 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:19.017867 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60856a-8b8c-4028-bc4e-377d51235800 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:19.034560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60856a-8b8c-4028-bc4e-377d51235800 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:19.155645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:19.156388 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:19.156671 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:19.156949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:19.157745 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:19.159743 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:19.200247 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1390/2783] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:14:19 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:19.204113 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:19.225561 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c40d-ef3b-489f-bd9e-d072999b59f6 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:19.241674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:19.242404 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:19.242684 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:19.242962 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:19.243690 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:19.245303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:19.274377 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1394/2784] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:19.278883 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:19.305044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2dc5b-0b82-4c97-bbf1-fd809d7b2942 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:19.317239 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:19.318884 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:19.319455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:19.319918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] PATH_INFO: `/v3/projects/31839085c4b54dc9bca009a954b5352d/users/17654c6f89a24161b8563f21895a985c/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:19.353375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31839085c4b54dc9bca009a954b5352d, user_id=17654c6f89a24161b8563f21895a985c, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:19.370762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:19.411265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1391/2785] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:19 2022] PUT /identity/v3/projects/31839085c4b54dc9bca009a954b5352d/users/17654c6f89a24161b8563f21895a985c/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:19.415694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:19.434003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfeb84-fdd9-47fe-83ad-39c80b2d4952 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:19.582635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a50f8-4d0e-4e72-9398-a12a5167ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:19.583666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a50f8-4d0e-4e72-9398-a12a5167ff15 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:19.589359 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a50f8-4d0e-4e72-9398-a12a5167ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:19.589917 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a50f8-4d0e-4e72-9398-a12a5167ff15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:19.591259 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a50f8-4d0e-4e72-9398-a12a5167ff15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:19.593653 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a50f8-4d0e-4e72-9398-a12a5167ff15 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:19.612975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1395/2786] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:19.616532 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:19.633784 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2df0c-7c76-4c6b-9c9f-e4865eae4ba7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:19.644541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:19.646173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:19.646459 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:19.647794 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] PATH_INFO: `/v3/projects/31839085c4b54dc9bca009a954b5352d/users/17654c6f89a24161b8563f21895a985c/roles/5df21f78b56544bab70a97ed6d984d60` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:19.655935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31839085c4b54dc9bca009a954b5352d, user_id=17654c6f89a24161b8563f21895a985c, role_id=5df21f78b56544bab70a97ed6d984d60)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:19.659150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:19.706217 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1392/2787] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:19 2022] PUT /identity/v3/projects/31839085c4b54dc9bca009a954b5352d/users/17654c6f89a24161b8563f21895a985c/roles/5df21f78b56544bab70a97ed6d984d60 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:19.707879 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca116cfd-ee03-4b33-89c9-e73b9f324f40 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:19.708349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca116cfd-ee03-4b33-89c9-e73b9f324f40 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:19.708791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca116cfd-ee03-4b33-89c9-e73b9f324f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:19.792008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-ca116cfd-ee03-4b33-89c9-e73b9f324f40 None None] MFA Rules not processed for user `17654c6f89a24161b8563f21895a985c`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:19.793502 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ca116cfd-ee03-4b33-89c9-e73b9f324f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:19.897585 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1396/2788] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:19.916020 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:19.917795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:20.051381 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f1a0-db74-42e3-ba8d-f6e70ce6114d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:20.056515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:20.056515 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:20.056723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:20.056954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:20.087128 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:20.092973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:20.133511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1393/2789] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:20.282455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca116cfd-ee03-4b33-89c9-e73b9f324f40 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:20.296237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca116cfd-ee03-4b33-89c9-e73b9f324f40 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:20.312417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe14727-a12a-4465-83b3-2bbe391d4bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:20.313110 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14727-a12a-4465-83b3-2bbe391d4bbc service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:20.313396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14727-a12a-4465-83b3-2bbe391d4bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:20.313710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14727-a12a-4465-83b3-2bbe391d4bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:20.451619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe14727-a12a-4465-83b3-2bbe391d4bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:20.453672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe14727-a12a-4465-83b3-2bbe391d4bbc service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:20.482620 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1397/2790] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:20.549900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:20.551629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:20.788088 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6bbb-297d-444f-b462-e03ac916135b service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:20.804153 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:20.806565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:20.807046 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:20.808422 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:20.813616 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:20.852397 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:20.854103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:20.868259 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1394/2791] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:21.028730 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f6b4-10fd-44b5-a14f-f239977fff1f None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:21.029630 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f6b4-10fd-44b5-a14f-f239977fff1f None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:21.030163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f6b4-10fd-44b5-a14f-f239977fff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:21.063016 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-6664f6b4-10fd-44b5-a14f-f239977fff1f None None] MFA Rules not processed for user `1fa0cd8ed723418daf1cbd6933e0ce6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:21.064788 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-6664f6b4-10fd-44b5-a14f-f239977fff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:21.139320 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1398/2792] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:23.685527 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:23.792558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd3e0-9ecf-4e32-b2e2-e299cba07721 service placement] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:23.800567 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:23.801828 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:23.802287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:23.802661 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] PATH_INFO: `/v3/users/411b0f6b2278430f9cacffd8e06546ba` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:23.815201 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=411b0f6b2278430f9cacffd8e06546ba)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:23.815448 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:23.902741 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411b0f6b2278430f9cacffd8e06546ba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:23.914748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411b0f6b2278430f9cacffd8e06546ba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:23.915578 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411b0f6b2278430f9cacffd8e06546ba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:23.916318 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411b0f6b2278430f9cacffd8e06546ba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:23.937276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411b0f6b2278430f9cacffd8e06546ba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:23.963272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1395/2793] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:14:23 2022] DELETE /identity/v3/users/411b0f6b2278430f9cacffd8e06546ba => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:23.965327 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:23.965901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:23.966398 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:24.001600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:24.003043 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:24.221424 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1399/2794] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:24.230953 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:24.232666 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:24.385073 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a605-c101-4337-b3c7-c6ffba4d3048 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:24.389212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:24.391145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:24.391643 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:24.392792 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:24.419813 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:24.421225 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:24.439593 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1396/2795] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:14:24.853674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:24.855225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:24.872181 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60046e-20b7-47f5-ac49-62c0b88a0eb6 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:24.878616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:24.880933 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:24.881447 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:24.882034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] PATH_INFO: `/v3/projects/9e329123ae6c447bb2ace12c8883bfe6` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:24.884215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e329123ae6c447bb2ace12c8883bfe6)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:24.892787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:24.996969 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e329123ae6c447bb2ace12c8883bfe6', 'request_id': 'req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.008666 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e329123ae6c447bb2ace12c8883bfe6', 'request_id': 'req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.015619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e329123ae6c447bb2ace12c8883bfe6', 'request_id': 'req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.032225 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] The token cache is being invalidate because project 9e329123ae6c447bb2ace12c8883bfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:25.032652 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.033665 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.041368 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:25.042001 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1400/2796] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:24 2022] DELETE /identity/v3/projects/9e329123ae6c447bb2ace12c8883bfe6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:25.057315 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f309-b740-4051-9292-25ce28432de4 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:25.191735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:25.192836 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:25.195123 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:25.195411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] PATH_INFO: `/v3/users/17654c6f89a24161b8563f21895a985c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:25.199628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17654c6f89a24161b8563f21895a985c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:25.201709 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:25.266207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17654c6f89a24161b8563f21895a985c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.280560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17654c6f89a24161b8563f21895a985c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.280560 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17654c6f89a24161b8563f21895a985c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.280877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17654c6f89a24161b8563f21895a985c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.301108 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-51f9209c-0f2f-48b9-8f71-1f07d96881d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17654c6f89a24161b8563f21895a985c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:25.325768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1397/2797] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:14:25 2022] DELETE /identity/v3/users/17654c6f89a24161b8563f21895a985c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:25.772385 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:25.775719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:25.834857 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee8eb9-0014-4ae7-b464-a6c8ec085fb8 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:25.983267 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:25.984850 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:25.985330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:25.993199 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] PATH_INFO: `/v3/projects/31839085c4b54dc9bca009a954b5352d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:25.995702 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=31839085c4b54dc9bca009a954b5352d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:25.998309 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:26.081938 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31839085c4b54dc9bca009a954b5352d', 'request_id': 'req-389df396-4481-4095-9b87-eb4ce49a0b3b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:26.098317 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31839085c4b54dc9bca009a954b5352d', 'request_id': 'req-389df396-4481-4095-9b87-eb4ce49a0b3b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:26.107096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31839085c4b54dc9bca009a954b5352d', 'request_id': 'req-389df396-4481-4095-9b87-eb4ce49a0b3b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:26.125608 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] The token cache is being invalidate because project 31839085c4b54dc9bca009a954b5352d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:26.126451 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:26.127303 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-389df396-4481-4095-9b87-eb4ce49a0b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:26.135899 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1401/2798] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:25 2022] DELETE /identity/v3/projects/31839085c4b54dc9bca009a954b5352d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:26.138007 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc414823-9ea4-4524-af2d-4882ae61ca5c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.138441 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc414823-9ea4-4524-af2d-4882ae61ca5c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.138644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc414823-9ea4-4524-af2d-4882ae61ca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.160437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-cc414823-9ea4-4524-af2d-4882ae61ca5c None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:26.161802 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cc414823-9ea4-4524-af2d-4882ae61ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:26.243261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1398/2799] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:26.251934 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a779567-9249-454d-bcff-f161e82d1dfa None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.252473 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a779567-9249-454d-bcff-f161e82d1dfa None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.253087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a779567-9249-454d-bcff-f161e82d1dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.291384 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9a779567-9249-454d-bcff-f161e82d1dfa None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:26.293063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9a779567-9249-454d-bcff-f161e82d1dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:26.313134 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1402/2800] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:26.317118 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc414823-9ea4-4524-af2d-4882ae61ca5c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:26.330713 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc414823-9ea4-4524-af2d-4882ae61ca5c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:26.345559 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:26.346179 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.351189 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.351748 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.353888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:14:26.357711 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:26.360494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:26.377228 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1399/2801] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:14:26.381396 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a779567-9249-454d-bcff-f161e82d1dfa None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:26.399740 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a779567-9249-454d-bcff-f161e82d1dfa None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:26.405269 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:26.406597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.407039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.407496 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.408349 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:26.410719 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:26.470542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1403/2802] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:14:26 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:26.473954 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:26.489542 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbcc33-e640-4ab5-9b24-60a0d2242135 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:26.571455 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:26.572928 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.573218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.573510 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.574889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:26.577267 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:26.613269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1400/2803] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:14:26 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:14:26.617868 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:26.645214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1534-f129-4f26-a9d0-559f81783b9e admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:26.661775 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:26.663525 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.668468 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.669512 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.673591 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:26.675369 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:26.712152 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1404/2804] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:26.716897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:26.734485 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c8242-7024-4b88-81ec-87e7ee659200 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:26.751803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b26e95-4ee7-40c2-94b3-f9422e66c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:26.752495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26e95-4ee7-40c2-94b3-f9422e66c755 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.754651 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26e95-4ee7-40c2-94b3-f9422e66c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.755175 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26e95-4ee7-40c2-94b3-f9422e66c755 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.756131 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b26e95-4ee7-40c2-94b3-f9422e66c755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:26.759181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b26e95-4ee7-40c2-94b3-f9422e66c755 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:26.782809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1401/2805] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:14:26.787023 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:26.801456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc67ee-649f-4cda-869b-8721185dfc70 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:26.822845 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:26.823542 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.823819 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.824172 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] PATH_INFO: `/v3/projects/f7c9ceb838e1404d99765272c3a80e50/users/91996ce5c0c34250872c12e5b82f0408/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.856491 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c9ceb838e1404d99765272c3a80e50, user_id=91996ce5c0c34250872c12e5b82f0408, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:26.859421 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:26.894681 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1405/2806] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:14:26 2022] PUT /identity/v3/projects/f7c9ceb838e1404d99765272c3a80e50/users/91996ce5c0c34250872c12e5b82f0408/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:26.906541 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb653f5e-83f6-46bc-99d9-8ff82267ef92 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:26.906900 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb653f5e-83f6-46bc-99d9-8ff82267ef92 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:26.907274 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb653f5e-83f6-46bc-99d9-8ff82267ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:26.996973 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fb653f5e-83f6-46bc-99d9-8ff82267ef92 None None] MFA Rules not processed for user `91996ce5c0c34250872c12e5b82f0408`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:26.998487 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fb653f5e-83f6-46bc-99d9-8ff82267ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:27.107269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1402/2807] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:28.827827 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:28.830517 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:28.886549 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7765-81d6-4d7f-b54e-082eb5876f22 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:28.890060 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34c660-7eae-4438-a6e9-75da8bc41f1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9c380955a04c24af2823e22fe3ec70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:28.890746 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c660-7eae-4438-a6e9-75da8bc41f1e service glance] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:28.891279 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c660-7eae-4438-a6e9-75da8bc41f1e service glance] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:28.891552 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c660-7eae-4438-a6e9-75da8bc41f1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:28.899910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34c660-7eae-4438-a6e9-75da8bc41f1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:28.901351 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34c660-7eae-4438-a6e9-75da8bc41f1e service glance] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:28.910456 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1406/2808] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:29.167665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:29.168245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:29.168245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:29.187503 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] MFA Rules not processed for user `0e0b0f5728f244578741648259bbcd59`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:29.188904 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:29.248833 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1403/2809] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:33.151443 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950361e-8791-4fd8-bb51-7a8a81734625 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:33.152572 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950361e-8791-4fd8-bb51-7a8a81734625 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:33.153046 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950361e-8791-4fd8-bb51-7a8a81734625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:33.194247 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-9950361e-8791-4fd8-bb51-7a8a81734625 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:33.196277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9950361e-8791-4fd8-bb51-7a8a81734625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:33.310108 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1407/2810] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:33.325103 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:33.327438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:33.421437 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1673c35-3764-4722-88b8-406b3cc4326f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:33.428827 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:33.430051 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:33.430465 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:33.431044 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:33.444778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:33.446554 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:33.456471 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1404/2811] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:14:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 19:14:43.935900 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bbfd-e203-4b07-a46d-c7475892c7ee None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:43.936435 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bbfd-e203-4b07-a46d-c7475892c7ee None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:43.940478 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bbfd-e203-4b07-a46d-c7475892c7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:43.962214 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-5ad9bbfd-e203-4b07-a46d-c7475892c7ee None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:43.963741 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-5ad9bbfd-e203-4b07-a46d-c7475892c7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:43.972123 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1408/2812] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:14:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:43.986454 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:43.999607 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9d37-ab83-4aff-9708-25f04f68737e service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:44.005587 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:44.006257 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:44.006540 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:44.007374 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:44.017373 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:44.018977 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:44.033796 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1405/2813] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:14:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:14:44.548878 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7957a-e2f9-4617-82d0-f4465d14e8f2 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:44.549186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7957a-e2f9-4617-82d0-f4465d14e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:44.549469 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7957a-e2f9-4617-82d0-f4465d14e8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:44.567029 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-34c7957a-e2f9-4617-82d0-f4465d14e8f2 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:44.568133 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-34c7957a-e2f9-4617-82d0-f4465d14e8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:44.576003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1409/2814] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 19:14:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:14:44.588060 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:44.598234 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127b973-17fa-4a95-a5b2-28804dead63f service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:44.603644 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:44.604263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:44.604536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:44.604804 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:44.612399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:44.613987 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:44.622439 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1406/2815] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 19:14:44.804014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5ca32-a4f7-4677-8c18-cc31c6fe2aa9 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:44.804302 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5ca32-a4f7-4677-8c18-cc31c6fe2aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:44.804578 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5ca32-a4f7-4677-8c18-cc31c6fe2aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:44.821810 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3da5ca32-a4f7-4677-8c18-cc31c6fe2aa9 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:44.822924 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3da5ca32-a4f7-4677-8c18-cc31c6fe2aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:44.829901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1410/2816] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 19:14:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:44.842004 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:44.852853 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddbffc-321f-418b-a493-6f348fda0b59 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:44.857888 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:44.858581 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:44.858861 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:44.859136 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:44.866926 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:44.868472 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:44.876642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1407/2817] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:14:45.207711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:45.208197 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:45.208300 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:45.227416 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:45.228607 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:45.235871 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1411/2818] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 19:14:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:45.248034 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:45.259375 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9c3d-f7e1-49bf-8e93-ba4543e86ab8 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:45.264289 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6087c-83b4-4518-bd98-f54d6a53455a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:45.264922 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6087c-83b4-4518-bd98-f54d6a53455a service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:45.265200 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6087c-83b4-4518-bd98-f54d6a53455a service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:45.265680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6087c-83b4-4518-bd98-f54d6a53455a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:45.274758 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6087c-83b4-4518-bd98-f54d6a53455a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:45.276315 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6087c-83b4-4518-bd98-f54d6a53455a service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:45.284894 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1408/2819] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:14:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:14:47.336787 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:47.338277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:47.400694 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787679f-fe0a-44f0-a706-5aa9868200d0 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:47.405162 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:47.406047 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:47.406330 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:47.406606 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] PATH_INFO: `/v3/users/2fbc2486d3ef49b79d8422f25b6d0257` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:47.407833 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbc2486d3ef49b79d8422f25b6d0257)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:47.409720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:47.460495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbc2486d3ef49b79d8422f25b6d0257'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:47.471308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbc2486d3ef49b79d8422f25b6d0257'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:47.472132 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbc2486d3ef49b79d8422f25b6d0257'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:47.483024 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbc2486d3ef49b79d8422f25b6d0257'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:47.484131 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbc2486d3ef49b79d8422f25b6d0257'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:47.503176 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1412/2820] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:14:47 2022] DELETE /identity/v3/users/2fbc2486d3ef49b79d8422f25b6d0257 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:14:47.507859 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:47.508338 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:47.508462 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:47.531940 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:14:47.533271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:47.613553 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1409/2821] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:14:47.623824 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:47.625594 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:47.694875 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034ff9-c7f7-46e4-85ee-19851155365c admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:47.699756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:47.700411 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:47.700696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:47.700973 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:47.714015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:47.715887 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:47.727346 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1413/2822] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:14:47.929283 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:14:47.930810 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:14:47.942465 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0d39a-5f76-4b0a-b9e8-5ca9f7de8d18 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:14:47.949039 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:14:47.951065 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:14:47.951573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:14:47.952122 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] PATH_INFO: `/v3/projects/3c331adb2d6541efbab26b5e11c096be` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:14:47.953691 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c331adb2d6541efbab26b5e11c096be)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:14:47.955911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:14:48.007072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c331adb2d6541efbab26b5e11c096be', 'request_id': 'req-edab50d5-14d0-4367-b5d2-b057326a8b7b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:48.012762 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c331adb2d6541efbab26b5e11c096be', 'request_id': 'req-edab50d5-14d0-4367-b5d2-b057326a8b7b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:48.021224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c331adb2d6541efbab26b5e11c096be', 'request_id': 'req-edab50d5-14d0-4367-b5d2-b057326a8b7b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:48.035887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] The token cache is being invalidate because project 3c331adb2d6541efbab26b5e11c096be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:14:48.036110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:48.036723 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:14:48.038885 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1410/2823] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:14:47 2022] DELETE /identity/v3/projects/3c331adb2d6541efbab26b5e11c096be => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:02.648186 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:02.649844 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:02.660758 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b999-1ba1-4755-9549-f4f6e7dd13be service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:02.708248 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74042346-a9d9-4139-beb8-0d4728b3c63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:02.708860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74042346-a9d9-4139-beb8-0d4728b3c63d service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:02.709293 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74042346-a9d9-4139-beb8-0d4728b3c63d service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:02.709616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74042346-a9d9-4139-beb8-0d4728b3c63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:02.711465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-74042346-a9d9-4139-beb8-0d4728b3c63d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:02.772945 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74042346-a9d9-4139-beb8-0d4728b3c63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:02.774465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74042346-a9d9-4139-beb8-0d4728b3c63d service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:02.783710 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1414/2824] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:15:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:15:04.424946 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:04.426915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:04.497281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab50d5-14d0-4367-b5d2-b057326a8b7b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:04.502048 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:04.502932 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:04.503214 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:04.503502 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] PATH_INFO: `/v3/users/91996ce5c0c34250872c12e5b82f0408` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:04.504795 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=91996ce5c0c34250872c12e5b82f0408)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:04.506761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:04.560277 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91996ce5c0c34250872c12e5b82f0408'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:04.568340 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91996ce5c0c34250872c12e5b82f0408'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:04.569638 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91996ce5c0c34250872c12e5b82f0408'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:04.570826 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91996ce5c0c34250872c12e5b82f0408'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:04.580967 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91996ce5c0c34250872c12e5b82f0408'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:04.601167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1411/2825] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:15:04 2022] DELETE /identity/v3/users/91996ce5c0c34250872c12e5b82f0408 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:04.605616 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:04.606472 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:04.606756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:04.624767 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:04.625999 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:04.698054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1415/2826] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:15:04.708145 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:04.710491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:04.788406 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc543b7-35b6-4751-a7c4-f67410d124ca admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:04.792224 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6523b-6502-4ee4-9c18-22a500b428f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:04.792881 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6523b-6502-4ee4-9c18-22a500b428f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:04.793159 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6523b-6502-4ee4-9c18-22a500b428f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:04.793591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6523b-6502-4ee4-9c18-22a500b428f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:04.804418 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6523b-6502-4ee4-9c18-22a500b428f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:04.805933 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6523b-6502-4ee4-9c18-22a500b428f8 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:04.818292 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1412/2827] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:15:05.233618 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:05.235463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:05.249711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7c986-3271-407b-81a7-ef20b085e248 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:05.256310 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:05.257183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.257455 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.257914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] PATH_INFO: `/v3/projects/f7c9ceb838e1404d99765272c3a80e50` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.259530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c9ceb838e1404d99765272c3a80e50)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:05.261798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:05.317968 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c9ceb838e1404d99765272c3a80e50', 'request_id': 'req-1a90974a-fb20-4133-af2e-93b23a352442'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:05.331950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c9ceb838e1404d99765272c3a80e50', 'request_id': 'req-1a90974a-fb20-4133-af2e-93b23a352442'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:05.342287 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c9ceb838e1404d99765272c3a80e50', 'request_id': 'req-1a90974a-fb20-4133-af2e-93b23a352442'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:05.354733 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] The token cache is being invalidate because project f7c9ceb838e1404d99765272c3a80e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:15:05.355045 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:05.355918 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-1a90974a-fb20-4133-af2e-93b23a352442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:05.357556 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1416/2828] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:15:05 2022] DELETE /identity/v3/projects/f7c9ceb838e1404d99765272c3a80e50 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:05.363412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3d2f2-74ba-4b60-af7b-4f67e4401e52 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.363412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3d2f2-74ba-4b60-af7b-4f67e4401e52 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.363412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3d2f2-74ba-4b60-af7b-4f67e4401e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.381680 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b6b3d2f2-74ba-4b60-af7b-4f67e4401e52 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:05.383096 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b6b3d2f2-74ba-4b60-af7b-4f67e4401e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:05.459442 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1413/2829] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:15:05.467640 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a556d-4384-4f88-8007-08c18e9d7a95 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.468034 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a556d-4384-4f88-8007-08c18e9d7a95 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.468236 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a556d-4384-4f88-8007-08c18e9d7a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.491051 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-417a556d-4384-4f88-8007-08c18e9d7a95 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:05.492884 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-417a556d-4384-4f88-8007-08c18e9d7a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:05.502038 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1417/2830] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:15:05.506412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3d2f2-74ba-4b60-af7b-4f67e4401e52 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:05.517204 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3d2f2-74ba-4b60-af7b-4f67e4401e52 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:05.522968 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:05.523705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.524216 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.524612 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.525411 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:15:05.525824 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:05.527513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:05.540536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1414/2831] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:15:05.544834 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a556d-4384-4f88-8007-08c18e9d7a95 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:05.554727 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a556d-4384-4f88-8007-08c18e9d7a95 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:05.562161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:05.562923 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.563163 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.563429 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.564495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:05.566118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:05.594294 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1418/2832] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:15:05 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:15:05.598384 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:05.627984 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c08063-c8f0-401b-a117-25e52e1a5d1b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:05.696539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:05.697901 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.698295 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.698573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.699278 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:05.701276 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:05.733383 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1415/2833] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:15:05 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:15:05.737266 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:05.749669 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d602f88-9281-4af8-94d8-0554e958c3cf admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:05.760954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:05.765414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.765983 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.769254 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.776193 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:05.778118 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:05.807389 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1419/2834] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:15:05.811699 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:05.823921 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb722e2-3969-42d0-8f11-5571dfb26256 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:05.838858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79cfc-98aa-41c7-9a13-ee750df6bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:05.839782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79cfc-98aa-41c7-9a13-ee750df6bb25 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.840472 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79cfc-98aa-41c7-9a13-ee750df6bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.841271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79cfc-98aa-41c7-9a13-ee750df6bb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.842725 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b79cfc-98aa-41c7-9a13-ee750df6bb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:05.849294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b79cfc-98aa-41c7-9a13-ee750df6bb25 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:05.864782 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1416/2835] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:15:05.869223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:05.882009 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1c8df-5064-4ef3-896b-439ec71bfdba admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:05.890568 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:05.893099 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.893732 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.894227 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] PATH_INFO: `/v3/projects/d877bcd3f68d47158733489c86e657f8/users/5eceb0e35d9142feb217c5ddf590a5c2/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.913596 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d877bcd3f68d47158733489c86e657f8, user_id=5eceb0e35d9142feb217c5ddf590a5c2, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:05.916910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:05.945103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1420/2836] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:15:05 2022] PUT /identity/v3/projects/d877bcd3f68d47158733489c86e657f8/users/5eceb0e35d9142feb217c5ddf590a5c2/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:05.946740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:05.947040 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:05.947342 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:05.985831 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] MFA Rules not processed for user `5eceb0e35d9142feb217c5ddf590a5c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:05.987106 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:06.064599 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1417/2837] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:15:06.075428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:06.077423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:06.137436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc975b0-8a6b-4b40-ad57-ab9320f025b1 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:06.141529 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9c380955a04c24af2823e22fe3ec70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:06.142177 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:06.142454 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:06.142724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:06.151292 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:06.152711 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:06.161532 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1421/2838] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:15:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:15:07.398202 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:07.399648 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:07.463778 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad641a7-6eed-44a9-b550-99771c07f51c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:07.469246 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241e70-7587-45e4-b7cb-6a497352867d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:07.470339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241e70-7587-45e4-b7cb-6a497352867d service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:07.470622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241e70-7587-45e4-b7cb-6a497352867d service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:07.470897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241e70-7587-45e4-b7cb-6a497352867d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:07.472708 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d7241e70-7587-45e4-b7cb-6a497352867d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:07.541009 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7241e70-7587-45e4-b7cb-6a497352867d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:07.542478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7241e70-7587-45e4-b7cb-6a497352867d service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:07.551913 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1418/2839] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:15:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:15:32.676571 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:32.735689 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b3bb-7d34-47eb-b85a-c6f0fdd03462 service glance] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:32.740097 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:32.740952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:32.741250 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:32.741551 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] PATH_INFO: `/v3/users/5eceb0e35d9142feb217c5ddf590a5c2` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:32.742709 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eceb0e35d9142feb217c5ddf590a5c2)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:32.744611 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:32.787939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eceb0e35d9142feb217c5ddf590a5c2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:32.795096 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eceb0e35d9142feb217c5ddf590a5c2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:32.795747 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eceb0e35d9142feb217c5ddf590a5c2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:32.802252 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eceb0e35d9142feb217c5ddf590a5c2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:32.802883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eceb0e35d9142feb217c5ddf590a5c2'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:32.819226 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1422/2840] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:15:32 2022] DELETE /identity/v3/users/5eceb0e35d9142feb217c5ddf590a5c2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:32.823690 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:32.824186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:32.824297 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:32.841237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:32.842456 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:32.899256 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1419/2841] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:15:32.908673 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:32.910022 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:32.964888 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28d8d-3d28-4d82-84a3-d92770a109ba admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:32.968558 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77ab46-94fb-4c64-9cc1-a06529876400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:32.969202 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ab46-94fb-4c64-9cc1-a06529876400 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:32.969507 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ab46-94fb-4c64-9cc1-a06529876400 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:32.969785 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ab46-94fb-4c64-9cc1-a06529876400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:32.979477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77ab46-94fb-4c64-9cc1-a06529876400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:32.980901 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77ab46-94fb-4c64-9cc1-a06529876400 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:32.990419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1423/2842] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:15:33.249322 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.250749 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:33.262513 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10aff3-512e-4c90-8126-ae5a1682d71e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.267284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.268081 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.268353 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.268618 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] PATH_INFO: `/v3/projects/d877bcd3f68d47158733489c86e657f8` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.269807 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d877bcd3f68d47158733489c86e657f8)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.271697 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.317887 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd877bcd3f68d47158733489c86e657f8', 'request_id': 'req-9ef3bfea-e17b-456b-8388-295b044a322a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:33.323584 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd877bcd3f68d47158733489c86e657f8', 'request_id': 'req-9ef3bfea-e17b-456b-8388-295b044a322a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:33.330306 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd877bcd3f68d47158733489c86e657f8', 'request_id': 'req-9ef3bfea-e17b-456b-8388-295b044a322a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:33.341261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] The token cache is being invalidate because project d877bcd3f68d47158733489c86e657f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:15:33.341566 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:33.342173 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ef3bfea-e17b-456b-8388-295b044a322a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:15:33.343682 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1420/2843] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:15:33 2022] DELETE /identity/v3/projects/d877bcd3f68d47158733489c86e657f8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:33.348436 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f913-99a3-483b-bda7-04aadeded8fd None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.348720 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f913-99a3-483b-bda7-04aadeded8fd None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.348996 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f913-99a3-483b-bda7-04aadeded8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.366537 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-f532f913-99a3-483b-bda7-04aadeded8fd None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:33.367723 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f532f913-99a3-483b-bda7-04aadeded8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:33.427308 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1424/2844] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:15:33.435042 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ae0d1-04e3-47c3-ae8c-e36c541e654b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.435326 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ae0d1-04e3-47c3-ae8c-e36c541e654b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.435600 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ae0d1-04e3-47c3-ae8c-e36c541e654b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.453966 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-324ae0d1-04e3-47c3-ae8c-e36c541e654b None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:33.455134 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-324ae0d1-04e3-47c3-ae8c-e36c541e654b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:33.463366 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1421/2845] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:15:33.467360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f913-99a3-483b-bda7-04aadeded8fd None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.476756 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f913-99a3-483b-bda7-04aadeded8fd None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.481245 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.481922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.482201 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.482476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.483183 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:15:33.483487 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.485071 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.496560 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1425/2846] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:15:33.500511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ae0d1-04e3-47c3-ae8c-e36c541e654b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.509927 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ae0d1-04e3-47c3-ae8c-e36c541e654b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.514419 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.515041 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.515316 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.515830 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.516507 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.518404 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.542343 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1422/2847] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 19:15:33 2022] POST /identity/v3/projects => generated 363 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:15:33.546323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.556423 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb40b4-71a4-4413-8137-cf25a488b7ba admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.608734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.609382 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.609687 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.609959 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] PATH_INFO: `/v3/users` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.610623 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.612625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.631674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1426/2848] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 19:15:33 2022] POST /identity/v3/users => generated 282 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:15:33.636110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.646152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b9b12-e36e-4ad0-ab5d-de5dcc7ca68d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.650672 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.651309 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.651582 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.651849 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.652546 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.654174 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.664190 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1423/2849] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:15:33.667771 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.677223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445183-a03c-4f0a-87f7-dc1bbabe8827 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.682364 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d254c74-8013-4e68-8173-c972432e216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.682955 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d254c74-8013-4e68-8173-c972432e216f admin admin] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.683233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d254c74-8013-4e68-8173-c972432e216f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.683503 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d254c74-8013-4e68-8173-c972432e216f admin admin] PATH_INFO: `/v3/roles` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.684207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d254c74-8013-4e68-8173-c972432e216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.685798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d254c74-8013-4e68-8173-c972432e216f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.695954 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1427/2850] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 19:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:15:33.699878 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.709645 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec5291-9087-4e1c-9d95-2673aa68b7ae admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.714347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.715354 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.715640 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.715914 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] PATH_INFO: `/v3/projects/6a153e1d943e41dc9c43cee041a0f952/users/e56d94ddf9de481d98dea412a267653d/roles/6a66b6a23fc641d6bc44da62f92e5825` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.730050 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a153e1d943e41dc9c43cee041a0f952, user_id=e56d94ddf9de481d98dea412a267653d, role_id=6a66b6a23fc641d6bc44da62f92e5825)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.732675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.746019 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1424/2851] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 19:15:33 2022] PUT /identity/v3/projects/6a153e1d943e41dc9c43cee041a0f952/users/e56d94ddf9de481d98dea412a267653d/roles/6a66b6a23fc641d6bc44da62f92e5825 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:33.756042 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.756328 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.756600 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.782182 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] MFA Rules not processed for user `e56d94ddf9de481d98dea412a267653d`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:15:33.783374 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:33.843849 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1428/2852] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:15:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:15:33.855263 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:33.856950 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:33.910656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531765ca-54ce-4350-aecf-c6b887d6b915 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:33.914735 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423abd-d050-4ab1-8850-6fda40ea1a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:33.915365 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423abd-d050-4ab1-8850-6fda40ea1a38 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:33.915642 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423abd-d050-4ab1-8850-6fda40ea1a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:33.915910 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423abd-d050-4ab1-8850-6fda40ea1a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:33.923852 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423abd-d050-4ab1-8850-6fda40ea1a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:33.925266 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423abd-d050-4ab1-8850-6fda40ea1a38 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:33.934511 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1425/2853] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:15:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:15:57.559766 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:57.561156 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:57.573033 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb817-7d42-4c54-a1ab-265612a6323c None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:57.577237 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e39540c05b40402786e682d974ee6018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:57.577902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:57.578185 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:57.578459 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:57.580126 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:57.635950 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:57.638065 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:57.647190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1429/2854] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:15:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:16:01.198314 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e5e2d-d599-406b-a3e2-f82df0261972 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:01.198809 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e5e2d-d599-406b-a3e2-f82df0261972 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:01.198915 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e5e2d-d599-406b-a3e2-f82df0261972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:01.215218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-677e5e2d-d599-406b-a3e2-f82df0261972 None None] MFA Rules not processed for user `3c8b295066bc4ae695f6e60b9b3dc5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:16:01.216895 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-677e5e2d-d599-406b-a3e2-f82df0261972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:01.223629 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1426/2855] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:16:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:16:10.619124 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:10.678207 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70625a-1064-4fad-86f0-02b0f33f8603 service cinder] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:10.682625 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:10.683476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:10.683749 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:10.684014 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] PATH_INFO: `/v3/users/e56d94ddf9de481d98dea412a267653d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:10.685168 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56d94ddf9de481d98dea412a267653d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:10.687734 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:10.731161 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56d94ddf9de481d98dea412a267653d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:10.738425 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56d94ddf9de481d98dea412a267653d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:10.739056 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56d94ddf9de481d98dea412a267653d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:10.745821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56d94ddf9de481d98dea412a267653d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:10.746463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56d94ddf9de481d98dea412a267653d'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:10.762902 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1430/2856] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:16:10 2022] DELETE /identity/v3/users/e56d94ddf9de481d98dea412a267653d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:16:10.767717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:10.768227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:10.768336 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:10.785683 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] MFA Rules not processed for user `5b85f3c3beaa4b878ef617b7b044b497`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:16:10.786855 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:10.841565 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1427/2857] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 19:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:16:10.851527 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:10.852839 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:10.908748 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39e3d-39ad-41ee-9880-2552d83ef301 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:10.912323 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:10.912952 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:10.913228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:10.913530 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:10.922798 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:10.924206 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:10.933336 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1431/2858] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:16:11.188803 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:11.190248 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:11.202734 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c904ed-43ff-4f76-bc5f-7851672bd1a1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:11.207327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:11.208184 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:11.208495 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:11.208761 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] PATH_INFO: `/v3/projects/6a153e1d943e41dc9c43cee041a0f952` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:11.209981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a153e1d943e41dc9c43cee041a0f952)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:11.211981 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:11.260195 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a153e1d943e41dc9c43cee041a0f952', 'request_id': 'req-6d983bbe-7dd3-4e23-aa8d-31393336da73'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:11.266536 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a153e1d943e41dc9c43cee041a0f952', 'request_id': 'req-6d983bbe-7dd3-4e23-aa8d-31393336da73'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:11.274072 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a153e1d943e41dc9c43cee041a0f952', 'request_id': 'req-6d983bbe-7dd3-4e23-aa8d-31393336da73'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:11.286272 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] The token cache is being invalidate because project 6a153e1d943e41dc9c43cee041a0f952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:16:11.286558 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:11.287181 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:11.301490 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1428/2859] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:16:11 2022] DELETE /identity/v3/projects/6a153e1d943e41dc9c43cee041a0f952 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:16:13.597013 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:13.605371 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e55f-1203-4656-8bef-1cedb4b1b74e service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:13.653779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16af25-8109-4040-8bbd-9bc12da50459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:13.654420 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16af25-8109-4040-8bbd-9bc12da50459 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:13.654701 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16af25-8109-4040-8bbd-9bc12da50459 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:13.654975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16af25-8109-4040-8bbd-9bc12da50459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:13.656715 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-ed16af25-8109-4040-8bbd-9bc12da50459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:13.722712 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16af25-8109-4040-8bbd-9bc12da50459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:13.724122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16af25-8109-4040-8bbd-9bc12da50459 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:13.735316 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1432/2860] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:16:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:16:16.063187 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:16.064798 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:16.077717 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983bbe-7dd3-4e23-aa8d-31393336da73 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:16.081211 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:16.081877 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:16.082156 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:16.082426 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:16.084146 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:16.097350 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:16.098789 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:16.110237 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1429/2861] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:16:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:16:36.299490 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] REQUEST_METHOD: `POST` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:36.299929 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:36.300081 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:36.317797 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.auth.core [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] MFA Rules not processed for user `3c6b49d2b3904ceca7db22423b2e7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:16:36.318982 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:36.370693 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1433/2862] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 19:16:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:16:36.420551 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:36.421976 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:36.488265 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed9f3-53d5-4b70-ac35-691b45cc5df7 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:36.493079 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9763d8a5c040ce876a787bed7fc954', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:36.493746 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:36.494021 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:36.494287 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:36.502417 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:36.503970 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:36.511656 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1430/2863] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 19:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:16:43.099261 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:43.100812 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:43.167975 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572efef3-1383-451c-93f7-9624c2e01600 None None] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:43.173020 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:43.173914 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:43.174192 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:43.174461 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] PATH_INFO: `/v3/users/0e0b0f5728f244578741648259bbcd59` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:43.175642 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0b0f5728f244578741648259bbcd59)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:43.177570 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:43.221103 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0b0f5728f244578741648259bbcd59'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.227724 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0b0f5728f244578741648259bbcd59'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.228380 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0b0f5728f244578741648259bbcd59'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.236215 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0b0f5728f244578741648259bbcd59'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.236837 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0b0f5728f244578741648259bbcd59'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.253617 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1434/2864] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:16:43 2022] DELETE /identity/v3/users/0e0b0f5728f244578741648259bbcd59 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:16:43.417918 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:43.429998 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e4884-241f-48f3-a2db-efc8b22ef69b service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:43.485815 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:43.486665 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:43.486944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:43.487218 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] PATH_INFO: `/v3/projects/a92a32956353454db32509526ff751da` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:43.488443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92a32956353454db32509526ff751da)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:43.490392 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:43.535331 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92a32956353454db32509526ff751da', 'request_id': 'req-ac42557f-c9bc-46f2-96f2-85fa4a36798e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.540573 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92a32956353454db32509526ff751da', 'request_id': 'req-ac42557f-c9bc-46f2-96f2-85fa4a36798e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.547269 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92a32956353454db32509526ff751da', 'request_id': 'req-ac42557f-c9bc-46f2-96f2-85fa4a36798e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.557979 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] The token cache is being invalidate because project a92a32956353454db32509526ff751da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:16:43.558261 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.558875 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.560410 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1431/2865] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:16:43 2022] DELETE /identity/v3/projects/a92a32956353454db32509526ff751da => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:16:43.564476 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:43.565898 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:43.579064 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530241-c5be-4760-b493-edfcf8626c47 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:43.634939 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:43.635721 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:43.636005 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:43.636280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] PATH_INFO: `/v3/users/2b703924efe74780a8293d58d684ea84` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:43.637444 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b703924efe74780a8293d58d684ea84)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:43.639361 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:43.682577 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b703924efe74780a8293d58d684ea84'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.689796 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b703924efe74780a8293d58d684ea84'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.690453 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b703924efe74780a8293d58d684ea84'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.697223 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b703924efe74780a8293d58d684ea84'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.697842 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b703924efe74780a8293d58d684ea84'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:43.715419 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1435/2866] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:16:43 2022] DELETE /identity/v3/users/2b703924efe74780a8293d58d684ea84 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:16:43.888408 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:16:43.890692 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:16:43.904091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42557f-c9bc-46f2-96f2-85fa4a36798e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:16:43.961030 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:16:43.961935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:16:43.962207 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:16:43.962478 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] PATH_INFO: `/v3/projects/0756fee562b84347967bbed713442101` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:16:43.963664 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0756fee562b84347967bbed713442101)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:16:43.965598 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:16:44.010250 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0756fee562b84347967bbed713442101', 'request_id': 'req-1f3a3174-68fb-4b74-a8fc-2b711b162324'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:44.016186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0756fee562b84347967bbed713442101', 'request_id': 'req-1f3a3174-68fb-4b74-a8fc-2b711b162324'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:44.023768 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0756fee562b84347967bbed713442101', 'request_id': 'req-1f3a3174-68fb-4b74-a8fc-2b711b162324'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:44.035152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] The token cache is being invalidate because project 0756fee562b84347967bbed713442101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:16:44.035703 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:44.036371 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:16:44.037975 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1432/2867] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:16:43 2022] DELETE /identity/v3/projects/0756fee562b84347967bbed713442101 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:17:20.735937 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:17:20.737524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:20.798698 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d9b0b-8a78-451e-a813-36b8bc0c11e7 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:17:20.847054 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:17:20.847774 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:17:20.848190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:17:20.848674 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:17:20.850912 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:20.863821 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:17:20.865324 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:17:20.874690 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1436/2868] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:17:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:17:40.606339 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:17:40.608465 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:40.620539 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a3174-68fb-4b74-a8fc-2b711b162324 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:17:40.624632 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:17:40.625294 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:17:40.625602 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:17:40.625874 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:17:40.627601 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:40.637787 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:17:40.639245 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:17:40.647494 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1433/2869] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:17:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:17:41.745621 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:17:41.754670 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afcbe-6c2d-47cf-a62c-ecafbee78fd7 service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:17:41.758233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:17:41.758861 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:17:41.759141 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:17:41.759415 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:17:41.761194 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:41.832779 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:17:41.834241 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:17:41.845019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1437/2870] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:17:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:17:41.905496 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:17:41.906905 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:41.973352 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4705a-a9db-460f-b926-d5649ce49b8e service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:17:41.978412 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:17:41.978996 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:17:41.979275 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:17:41.979549 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:17:41.981303 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:41.992891 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:17:41.994475 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:17:42.004605 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1434/2871] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:17:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:17:42.636858 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:17:42.638841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:42.652619 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfaee3-4d6d-456d-ac44-891f07623fcb service neutron] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:17:42.660832 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:17:42.661536 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:17:42.661818 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:17:42.662086 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:17:42.663872 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:42.678465 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:17:42.680190 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:17:42.691055 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1438/2872] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:17:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:17:47.767161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:17:47.769327 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:47.784974 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344430e-2a82-4c73-83ad-8bfdff0f1767 service placement] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:17:47.790678 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:17:47.791344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:17:47.791628 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:17:47.791898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:17:47.794569 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:47.809167 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:17:47.812000 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:17:47.829550 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1435/2873] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:17:50.094628 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:17:50.107232 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c5ebe-9adf-46fd-ae4b-09973134a3ed service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:17:50.112869 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:17:50.113635 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:17:50.113974 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:17:50.114477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:17:50.116683 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:17:50.130280 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:17:50.131981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:17:50.149003 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1439/2874] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:17:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:18:01.261227 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:18:01.271069 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af583-8cd0-43e8-8498-0f60003686c1 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:18:01.274675 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:18:01.275310 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:18:01.275589 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:18:01.275864 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:18:01.278152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:18:01.338438 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:18:01.339857 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:18:01.349898 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1436/2875] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:18:07.605696 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:18:07.607703 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:18:07.623550 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9830-6cc0-492f-8db5-e84ef953c015 service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:18:07.631910 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:18:07.632789 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:18:07.633070 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:18:07.633343 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] PATH_INFO: `/v3/users/3c8b295066bc4ae695f6e60b9b3dc5dd` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:18:07.634612 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8b295066bc4ae695f6e60b9b3dc5dd)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:18:07.636510 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:18:07.686474 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8b295066bc4ae695f6e60b9b3dc5dd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:07.693602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8b295066bc4ae695f6e60b9b3dc5dd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:07.694304 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8b295066bc4ae695f6e60b9b3dc5dd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:07.702672 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8b295066bc4ae695f6e60b9b3dc5dd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:07.703318 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8b295066bc4ae695f6e60b9b3dc5dd'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:07.721602 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1440/2876] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:18:07 2022] DELETE /identity/v3/users/3c8b295066bc4ae695f6e60b9b3dc5dd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:18:07.884880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:18:07.894911 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e989f-a006-4525-b3e3-8f93dd313ace service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:18:07.957323 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:18:07.958213 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:18:07.958491 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:18:07.958765 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] PATH_INFO: `/v3/projects/157e9c40125e42b4b5a908fc58bfa939` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:18:07.959944 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157e9c40125e42b4b5a908fc58bfa939)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:18:07.961889 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:18:08.006949 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157e9c40125e42b4b5a908fc58bfa939', 'request_id': 'req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.012091 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157e9c40125e42b4b5a908fc58bfa939', 'request_id': 'req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.019164 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157e9c40125e42b4b5a908fc58bfa939', 'request_id': 'req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.030161 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] The token cache is being invalidate because project 157e9c40125e42b4b5a908fc58bfa939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:18:08.030443 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.031055 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.032705 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1437/2877] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:18:07 2022] DELETE /identity/v3/projects/157e9c40125e42b4b5a908fc58bfa939 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:18:08.036573 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:18:08.037986 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:18:08.051224 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb118fe-6116-467a-abcf-0db6b588de1f admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:18:08.106025 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:18:08.106892 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:18:08.107169 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:18:08.107440 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] PATH_INFO: `/v3/users/1c9024a355504f07a760bcb6c2a79b6e` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:18:08.108806 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9024a355504f07a760bcb6c2a79b6e)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:18:08.110722 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:18:08.156891 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9024a355504f07a760bcb6c2a79b6e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.164122 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9024a355504f07a760bcb6c2a79b6e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.164981 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9024a355504f07a760bcb6c2a79b6e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.173019 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9024a355504f07a760bcb6c2a79b6e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.174057 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9024a355504f07a760bcb6c2a79b6e'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.193414 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1441/2878] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:18:08 2022] DELETE /identity/v3/users/1c9024a355504f07a760bcb6c2a79b6e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:18:08.360630 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:18:08.362056 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:18:08.376281 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ccf2c-d119-462e-85d7-0fda58b75ce6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:18:08.430337 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:18:08.431186 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:18:08.431460 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:18:08.431737 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] PATH_INFO: `/v3/projects/d3852d9773ae4f8d9747fa6de2cff3aa` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:18:08.432886 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3852d9773ae4f8d9747fa6de2cff3aa)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:18:08.435298 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:18:08.483413 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3852d9773ae4f8d9747fa6de2cff3aa', 'request_id': 'req-b5ac1337-c939-4ffe-8634-2bf2e273adcf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.488766 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3852d9773ae4f8d9747fa6de2cff3aa', 'request_id': 'req-b5ac1337-c939-4ffe-8634-2bf2e273adcf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.495840 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3852d9773ae4f8d9747fa6de2cff3aa', 'request_id': 'req-b5ac1337-c939-4ffe-8634-2bf2e273adcf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.507206 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] The token cache is being invalidate because project d3852d9773ae4f8d9747fa6de2cff3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:18:08.507493 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.508121 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:18:08.509687 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1438/2879] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:18:08 2022] DELETE /identity/v3/projects/d3852d9773ae4f8d9747fa6de2cff3aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:19:18.546791 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:19:18.548239 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:18.689277 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0399f8-8cfe-452a-b404-ed867be2f0a7 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:19:18.747838 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea420049f83643a19cb6c1d0a36fc8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:19:18.748480 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:19:18.748764 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:19:18.749039 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:19:18.750841 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:18.805373 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:19:18.806904 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:19:18.815597 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1442/2880] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:19:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:19:19.043029 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:19:19.044506 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:19.148380 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1337-c939-4ffe-8634-2bf2e273adcf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:19:19.152212 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f773f90b8c47608040ee24866242f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:19:19.152858 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:19:19.153137 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:19:19.153430 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:19:19.155253 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:19.234308 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:19:19.235756 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:19:19.254024 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1439/2881] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:19:20.367428 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:19:20.368801 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:20.471291 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b08c-5fd9-423c-bd79-207fc796fcde service nova] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:19:20.476358 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:19:20.476998 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] REQUEST_METHOD: `GET` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:19:20.477273 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:19:20.477574 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:19:20.479446 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:20.491233 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:19:20.492822 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:19:20.504098 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1443/2882] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:19:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:19:25.672832 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:19:25.674379 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:25.686835 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ed833-5aef-486d-810e-98a876f59524 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:19:25.691391 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:19:25.692242 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:19:25.692514 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:19:25.692777 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] PATH_INFO: `/v3/users/1fa0cd8ed723418daf1cbd6933e0ce6b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:19:25.693969 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa0cd8ed723418daf1cbd6933e0ce6b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:19:25.695893 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:19:25.748937 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa0cd8ed723418daf1cbd6933e0ce6b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:25.757152 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa0cd8ed723418daf1cbd6933e0ce6b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:25.757740 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa0cd8ed723418daf1cbd6933e0ce6b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:25.758344 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa0cd8ed723418daf1cbd6933e0ce6b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:25.766150 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa0cd8ed723418daf1cbd6933e0ce6b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:25.782199 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1440/2883] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:19:25 2022] DELETE /identity/v3/users/1fa0cd8ed723418daf1cbd6933e0ce6b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:19:25.951360 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:19:25.967524 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547fcf9-3619-4361-bf24-2220465dea28 service placement] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:19:26.030417 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:19:26.031697 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:19:26.032087 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:19:26.032366 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] PATH_INFO: `/v3/projects/cc0c73a5efc84e348363ae368873f51d` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:19:26.034008 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0c73a5efc84e348363ae368873f51d)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:19:26.035922 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:19:26.086015 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0c73a5efc84e348363ae368873f51d', 'request_id': 'req-cde258be-c62e-49be-88a3-ee8a7c837015'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.093864 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0c73a5efc84e348363ae368873f51d', 'request_id': 'req-cde258be-c62e-49be-88a3-ee8a7c837015'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.099781 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0c73a5efc84e348363ae368873f51d', 'request_id': 'req-cde258be-c62e-49be-88a3-ee8a7c837015'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.111495 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] The token cache is being invalidate because project cc0c73a5efc84e348363ae368873f51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:19:26.111786 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.112466 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.114063 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1444/2884] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:19:25 2022] DELETE /identity/v3/projects/cc0c73a5efc84e348363ae368873f51d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:19:26.118139 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:19:26.120251 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:26.132880 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667ad6-9761-437e-8b11-d8404a33e4b7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:19:26.187929 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:19:26.188837 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:19:26.189110 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:19:26.189398 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] PATH_INFO: `/v3/users/6e2938ee96d0473c99e7bb8252389329` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:19:26.190603 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2938ee96d0473c99e7bb8252389329)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:19:26.192622 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:19:26.239347 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2938ee96d0473c99e7bb8252389329'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.246663 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2938ee96d0473c99e7bb8252389329'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.247358 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2938ee96d0473c99e7bb8252389329'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.248013 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2938ee96d0473c99e7bb8252389329'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.254935 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2938ee96d0473c99e7bb8252389329'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.271617 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1441/2885] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 19:19:26 2022] DELETE /identity/v3/users/6e2938ee96d0473c99e7bb8252389329 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:19:26.443228 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Authenticating user token {{(pid=79881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:19:26.444860 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.fernet_utils [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:19:26.457609 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde258be-c62e-49be-88a3-ee8a7c837015 admin admin] Validating token access rules against request {{(pid=79881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:19:26.512994 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b85f3c3beaa4b878ef617b7b044b497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75aca24ee457414ebddf524e98cb22af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:19:26.513883 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:19:26.514167 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:19:26.514450 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] PATH_INFO: `/v3/projects/744b0f3356ab47b08317213c0f3055ba` {{(pid=79881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:19:26.515881 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=744b0f3356ab47b08317213c0f3055ba)` {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:19:26.517808 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] RBAC: Authorization granted {{(pid=79881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:19:26.560931 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744b0f3356ab47b08317213c0f3055ba', 'request_id': 'req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.567477 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744b0f3356ab47b08317213c0f3055ba', 'request_id': 'req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.572783 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744b0f3356ab47b08317213c0f3055ba', 'request_id': 'req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b'} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.583178 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] The token cache is being invalidate because project 744b0f3356ab47b08317213c0f3055ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:19:26.583463 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.584155 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: DEBUG keystone.notifications [None req-bf88f6cf-d2b0-4e69-90d5-111fe058b47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:19:26.585805 dv-cinder-830901-3-iscsi devstack@keystone.service[79881]: [pid: 79881|app: 0|req: 1445/2886] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 19:19:26 2022] DELETE /identity/v3/projects/744b0f3356ab47b08317213c0f3055ba => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:24:21.320994 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:24:21.322399 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:24:21.387488 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d15f9-5ed0-4d0f-9aa4-e3daa82e4375 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:24:21.442839 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69baec-c8ac-4102-aee8-8c38a719471e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eba1582c17e4df991452d433cbe567b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3121547cdfa74201b2bd9d6b8a59990e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:24:21.443992 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69baec-c8ac-4102-aee8-8c38a719471e service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:24:21.444271 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69baec-c8ac-4102-aee8-8c38a719471e service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:24:21.444544 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69baec-c8ac-4102-aee8-8c38a719471e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:24:21.446284 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0f69baec-c8ac-4102-aee8-8c38a719471e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:24:21.456995 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69baec-c8ac-4102-aee8-8c38a719471e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:24:21.458591 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69baec-c8ac-4102-aee8-8c38a719471e service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:24:21.468897 dv-cinder-830901-3-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1442/2887] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 19:24:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)